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Abstract* This thesis examines a tactile sensor and a thermal sensor [or use 
with the Utah-MIT dexterous four fingered hand. Sensory Feedback is critical for 
full utilisation of its advanced manipulatory capabilities. The hand itaelf provides 
tendon tensions and joint- angles information- However, planned control algorithms 
require more information than these sources can provide. 

The tactile sensor utilizes capacitive transduction with a novel design based 
entirely on silicone elastomers. It provides an S x 8 array of force cells with 1.9 mm 
center-fco-center spacing, A pressure resolution of S significant bits is available over 
a 0 to 200 grams per square nun range. The thermal sensor measures a material's 
heat conductivity by radiating heat into an object and measuring the resulting 
temperature variations. This sensor has a 4 x 4 array oF temperature celts with 
d.S mm ceriler-io-ccuLer spacing. Experiments show that the thermal sensor can 
discrimioate among material by detecting differences in their thermal conduction 
properties. Both sensors meet the stringent mounting requirements posed by the 
Utah-MIT hand. Combining them together to form a sensor with both tactile and 
thermal capabilities will ultimately be possible. 

The computational requirements for controlling a sensor equipped dexterous 
hand are severe. Conventional single processor computers do not provide adequate 
performance, To overcome these difficulties, a computational architecture based 
on interconnecting high performance microcomputers and a set of software prim¬ 
itives tailored for sensor driven control has been proposed. The system has been 
implemented and tested on the Utah-MIT hand. 

The hand, equipped with tactile and thermal sensors and controlled by its con>- 
putationa.1 architecture, is one oF th* most advanced robot it manipulatory' devices 
available worldwide. Other ongoing, projects will exploit these tools and allow the 
hand to perforin tasks Lhat exceed 41 ls capabilities of current generation robots. 


Thesis .Supervisor: Dr. John M. Hollerbaeh 
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Contact Sensing 
and Dexterous Hands 


Chapter 1 


Human hands have amazing versatility. Think oF the wide variety of Lasts that we 
effortlessly perform with them each day, They are used For manipulating objects, 
static grasping, and exploratory motions. Our hands are so effective at what they 
do that we often take them for granted. Take the task of pulling change out of a 
pocket. Since visual information, Ls of no Use for this operation, OUf hand*3 tactile 
capabilities play a crucial role in locating a coin. Then our fingers readily grasp the 
coin and perhaps re-orient it for better stability. Thermal sensing capabilities can 
also play a role by distinguishing the metal of the change from other objects that 
might be in the pocket. Finally, the soft surfaces of our linger Lips helps prevent 
the coin from slipping. 

Our hands perform so many task s wsth ease that they ulus L have a particularly 
effective design. Even more amazingly s they operate in entirely unstructured envi¬ 
ronments, When we are mending clothing no special jigs for accurate placement 
of stitches are required. Instead, our hands pick up the fabric arid start Rewing. 
Our fingers can position the mftteri&l and, move around the needle without any 
assistance. 

In some cases our hands arc not capable of performing a task alone and tools 

I 
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are required to help out. Bust think of how easily hands can use tools, It is hard to 
imagine a more versatile manipulatory system than a pair of hands with a suitable 
set of tools. In fact, the power of our bands and their ability to operate tools may 
very well be responsible for our success as a Species. 

Today’s robotic end effectors, on the Other hand, cannot rival the performance oF 
our hands. One of their biggest deficiencies is that they must operate in structured 
environments. It is assumed that the objects they manipulate are well modeled and 
that their positions are accurately known. When the structuring assumptions that 
have been made fail* the robot is often helpless and cannot perforin the desired task 
correctly. They usually Jack the kinds oT sensory Feedback necessary for analysing 
the world and modifying their actions to compensate For problems, 

In addition to a lack of sensing capabilities, their mechanical dexterity is atso not 
adequate for operating in an unstructured environment. Special jL rk. are required 
to make up for a robot’s iack of flexibility. The cost involved with making a 
robot’?. workspace suitable for it to operate in often exceeds the cost of the robot 
itself. Many manufacturing and assembly operations cannot be automated because 
of these severe limitations. More importantly, some uses for robots are entirely 
precluded by their need for a structured environment, 

Before robotic hands suitable for operation in unstructured environments eau 
be made, advances in manipulators, actuators, sensors, computer controllers, con¬ 
trol laws, planners, and robot programming languages are needed. Manipulator 
must be made more dexterous to permit complex grasping and orientation strate¬ 
gies. Actuators must be made faster and more compacL. Sensors must be durable, 
and should provide information that insure the robot correctly performs Its task. 
Computers need to be more powerful to handle the increased mechanical dexterity 
and the wealth of sensory data, Control laws must be extended to handle Ibe me¬ 
chanical structure of the advanced manipulators. Finally, tools must be developed 
to reduce the difficulty of programming a complex robot. 

Investigation of grasping and manipulatory strategies for a scissor equipped 
hand are needed before human dike performance can be achieved. One of the many 
open questions in hand control is how to determine the most effective grasp orien¬ 
tation for a particular object geometry. The definition oF “most effective* depends 



on the particular operation intended; for some tasks a patrrr grip that imparts 
maximum bolding force onto an object is test. Other times, a molffity grip that 
gives an object its greatest range of motions would be preferred. 

Contact sensors provide information that can simplify grasping operations. One 
important use for this information is- to verify a gripes stability. If a grip is failing, 
contact sensors can provide information on the direction the object is slipping, 
possibly allowing corrective action to be taken. If the angle of contact between 
a finger and an object is approaching the limits of the contact frictional cone, 
indicating that an unstable situation may be imminent., the finger orientations can 
be modified. 

Deiicate operations also require sensory feedback. To avoid breaking an egg. 
for example, the Finger’s contact force must be small, yet large enough to avoid 
slippage. Programming a hand to write OR paper probably requires carefully mon¬ 
itoring the position of the pen with respect to the fingers and paper. Flipping the 
pages of a book is tricky as well; a Light grip OH the paper is required to avoid rip¬ 
ping the page, while enough contact force must be applied to generate the friction 
needed to flip the sheet upward. These operations are even hard for humans, as 
we ail know from experience. 1 

The rewards, for building an advanced dexterous robot that rivals human per¬ 
formance are great. Assembly operations could be more highly automated. Special 
purpose part feeders might be replaced by a more general purpose hand, GonLact- 
sensors could resolve a part’s location and orientation, allowing the assembly op¬ 
eration to proceed smoothly. Thermal sensors could assist in Selecting a particular 
object from a hin of parts. For Insertion operations the tactile system Could detect 
jams, and then direct the hand to take the appropriate corrective action. A robot 
polishing a material's surface could use texture detection to judge the quality of 
the. finish. 

A robot, end effector that can operate in an unstructured environment will do 
more than advance the state of industrial automation, it can also relieve humans 

3 H’jntniu, af course, lr*rn from their mistakes. Ideally, a, hand should also benefit front Its fnilnres. 
Contact sensor* c»n a|jji? provide important snfrd-nkatLon hr MuEam*tk*Uy diagB£Sm£ why the 
planned! operation filled, and wll&l future corrective action would be best to iehe. 
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of tasks that they should not he performing. Undersea exploration, nuclear power 
plant repair* space exploration* and rescue operations are hazardous and unpleasant 
for humans to perform. An advanced dexLeroua robot Lhat can operate in an 
unstructured environment could be put to good use in these areas. 

A hand can be used for more than just grasping and manipulating objects. 
Ilapticn, where the hand is used as an exploratory tool, Is another important ap¬ 
plication. Exploratory motion is highly sensory driven" both contact sensors and 
joint positions provide information about an object and its environment. Texture 
and thermal clues can help a robot identify a material. Tracking an edge or seam 
to ascertain an object’s outline can be done with tactile feedback. Detecting the 
orientation of a small part using its force contact prolife is possible. Identifying 
a grasped object by mapping the finger contact locations and materia] type at 
those contact points to a library model has already been thcore tic ally studied by 
Grtmson and Lozano Perez jlftKS], The use of a hand as a sensory organ allows a 
robot t.o explore itg environment and gather information Lhat will help it perform 
its manipulatory Functions successfully. 

By building and programming a noboLic device with performance capabilities 
similar to that of a hand, we can better understand biological motor control. In¬ 
stead of just speculating on how the brain controls out hands, and on how sensory 
data is utilized* we Can actually test theories, on the robotic device. We can also go 
the other direction. That is, by studying human motion strategies we can develop 
better robotics control techniques, A manipulator with human-like mechanical and 
sensor capabilities allows us to use the every day experience we have using our own 
hands when programming the robotic hand. 

This thesis concentrates OIL two of the aforementioned problems; the lack of 
adequate sensors and the need for high performance- computer controllers. In the 
next section, Ml overview of sortie basic sensor driven control tasks- that a dexterous 
hand could perform is presented. The introduction then concludes with an overview 
of the work covered in the remainder of this thesis. 
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JL.l Relation to Other Sensing Modalities 

Sensors can be classified within the two broad categories of “non-contact” and 
“contact" devices. As one might ascertain from their names, non-contact sensors 
extract information passively, without making contact with the object being ob¬ 
served, Contact sensors, however, gather information by probing, poking, and 
otherwise disturbing the object at band. 

Vision ie perhaps the most important non-contact sense that, humans, and some 
robots, utilize. Sight gives a wealth of information about aspects of an environment 
that are unavailable to other sensory modalities- Uses for robotic vision systems 
include parts inspection, object identification, and character recognition. 

It should be noted that machine vision can provide some, but not all, of the 
functionality of a contact Sensing device. Thermal properties other than an object's 
temperature can only be obtained by a contact sensor. While vision can give useful 
views of an object provided adequate lighting is available, a contact sensor can 
provide same of the same information in the dark. An object’s surface profile 
and texture can only be indirectly obtained from vision, with variations in lighting 
conditions and viewing angles affecting the results. Clearly, a contact sensor obtains. 
this Information more accurately. 

Various other non-contact sensations arc useful at times. Sound detection pro¬ 
vides information in assembly operations. The “click* of two fastener coming 
together is a good indication that the task was completed successfully. Sonar is 
often used to help mobile robots navigate through rooms, and to help bats navigate 
through caves. 

Another non-coni act sense t-baL most humans have, and some robots may have 
in the near future, is smell. Smells add not only to our taste of Foods but they 
provide warnings of hazards that a visual system could not detect itself, A robotic 
developed by Ikegami and Kaueyasu [l9H5 iP duplicates some of the human's 
abilities, and can be put to use in situations where u human would rather not be 
sniffing. 

Fusion of data from multiple sensor sources supplemented by a knowledge base 
describing world objects will ultimately be possible. Using information contributed 
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l)y different sensing modalities reduces the chance of error, increasing the robustness 
of the overall system. Humans have a very robust integrated and intelligent sensor 
system. We receive information from touch, sound, sight, and srneHL The brain 
uses clues extracted from these sources, along with general knowledge of our world, 
to make all its sensor related decisions. 

Sensors play an important rote in the development of a dexterous robot capable 
of operating in an unstructured environment, The next section discusses bow to 
design them, 


1,3 A Sensor Design Methodology 

1 he design of contact Sensors should not be done in an ad hoc fashion. In particular, 
a number of questions should be answered before undertaking actual development. 
] he following paragraphs pose these questions and then discuss their relevance to 
the sensor design process. 

What (to y£m !cnn.( to This question, is not as obvious as- it, might Seem. 

Jft many cases the answer depends on the sensor’s intended uses. Tactile sensors, 
for example, mean different things to different people. For one particular applica¬ 
tion an array of binary contact detectors might suffice. OLher applications might 
require 16 bits of force data, or shear detection in addition to surface normal force 
information. Slip detection is often cited as an important capability for sensors. 
Without a clear idea of the sensor's intended function, it is very hard to build a 
useful device. 

Haw do you go ufouf sensing this quantity? Before a sensor can be designed, 
there must be a clear understanding of the phenomenon being sensed, and how 
it manifests itself OIL the environment. In the ease of slip detection, for example, 
Lt iss not obvious what a slipping object, does to a gripper that would indicate 
that lt is really slipping. It is Important to notice that this question should be 
answered separately from the question concerning the transduction technology to 
be employed. For example, to detect contact profiles a sensor must measure how 
its surface deflects when pressed against an object. So, contact profiles arc sensed 
by measuring a surface deformation. This observation docs not li-iVG any bearing 
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on what particular transduction technology should be used. 

Where is the senior to be used? The selection of an actual transduction process 
must lake into account such practical issues as how much apace is available fur 
mounting the device. Equally important Is to ascertain the expected operating 
environment- For example, will the device need special protection against damage? 
Special issues covering the packaging should also be addressed. A tactile sensor, 
for example, might, need a compliant, covering to increase frictional contact with 
a grasped object and for protection. Notice that these requirements can Interact 
with the transduction mechanism. Providing a compliant covering might reduce 
force sensing resolution, for erample- 

irons duel ton processes eon. be used? The answers to previous questions 
guide in answering this question. For example, if the sensor measures force by 
inducing a positional change In a material, the transduction process must delect 
this positional change. If there is no transduction process capable of detecting the 
environmental disturbance of interest., the previous question concerning w’hat Q11C 
wants to sense will need to be re-examined. 

ffoic docs the selected transduction process (vnrife? A full understanding of the 
transduction process will allow the sensor's performance to be optimized. In addi¬ 
tion, daws with the approach, if any, can be detected. The model of the transduc¬ 
tion process should incorporate the sensors interaction with its environment, 

H-OV> should the Sttisor be jabricoted? The answer to this question must incorpo¬ 
rate the answers to all the previous questions. The ultimate fabrication techniques 
chosen should provide packaging suitable for both the transduction principles em¬ 
ployed and for the intended use of the device; a tactile sensor that passed all 
performance specification with flying colors is of little use if it is too big to- fit in 
its intended mounting location. 

To begin the design process for the tactile and thermal sensors described within 
this report, a discussion of the Utah-MIT hand is necessary. This provides an 
answer to one of the most important of the previous questional where the Sensors 
are to be mounted. 
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Eiguro 1 . 1 : Photograph of The Utah-MIT 
1.3 The Utah-MIT Hand 

The Center for Engineering Design at the University of Utah and the Artificial In¬ 
telligence Laboratory at the Massachusetts Institute of Technology are developing 
a multi-fingered robot hand to pursue the achievement of advanced robot dexter¬ 
ity |Jacobsen ct. ah I9S4]. The Utah-MIT hand has been made of approximate 
anthropomorphic size and design, partly because the human hand is obviously a 
particularly effective design, and partly because existing experience in using our 
own hands can aid in thinking of control strategies for the robot band, The band 
has four fingers, arranged as three finger* in a planar sequence and an Opposing 
thumb. Each finger has four degrees of freedom, simitar to a human finger save that 
the two degree of freedom knuckle joint is split into separate abduction/adduction 
and flexion/extension joints for technical reasons of tendon routing, Four fingers 
were chosen, as & compromise to provide more functional capability than a three 
fingered hand | Mason and Sails bury 1Okada 19^1 because of object reori¬ 
entation ability and hand shaping functions, yet to avoid the added mechanical 
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Figure 1-2; 2"'fcr Utuh-MIT hand pozit.ianinrj iahit. 


complexity of five finger?, 

Each finger is driven by 8 tendons, which ia 3 more than required by the- rt-H 1 
minimum rule for tendons versus degrees of freedom Mason and Salisbury 1383], 
The trailSmission and actuation ayiatema are two of the more novel aspects of this 
hand design. The tendons are composed of specially woven keviar tapes* routed 
by pulleys across the finger joints and the wrist to the forearm actuator assembly. 
The 32 Electropneumatlc actuators have favorable power t.o weight ratios and can 
be adequately controlled for force. Sensor are provided for Lendon tension and joint 
poaitione- 

The hand itself is mounted onto the z axis of a 3 degrae-of-fieedom positioning 
table (Figure 1,2). The table’s surface moves in the uey plane, while the z axis 
is. translated by an independent y axis. The redundant y motion permits exper¬ 
imentation with tracking operations; an object moving in the t; direction of the 
positioning surface can be independently tracked by the hand. 
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1.4 Scope of thiH Thesis 

This thesis is motivated by the need to equip the Utah-MIT dexterous hand wiLh 
contact sensors,, Initially, an examination of commercially produced sensors pro¬ 
duced disappointing findings. No devjc.eE suitable for mounting on the fingers of 
the hand were found, Research sensors were more promising, but there were still 
no refined technologies that could be directly used in this project, In fact, the 
performance requirements we set for the tactile sensor were not all that stringent; 
it was the space and mounting constraints, as well as reliability issues, that became 
limiting factors, Thermal seniors were in a much less developed state. Only at 
the completion of this project did WC discover another thermal sensing, effort, con¬ 
ducted concurrently and independently of this work lltusseil 1983],. that examined 
some of the same issues covered in this thesis, 

The tactile sensor is based on variations in the distance between two parallel 
plates of a capacitor Siegel et al. 18S£|. Ah force on a sensor point is increased, 
the gap between the plates of a capacitor will decrease. The measured capacitance 
is related to the distance between the plates, and hence the force being applied 
at that point, A 8 x B array of capacitor ceiis is used, giving the device 64 force 
sensitive LacLile points. 

Thermal sensors can provide useful information about a manipulator’s envi¬ 
ronment, These devices are designed to measure the properties of a material that 
are related to its heat conduction and heat capacity, as well as its absolute tem¬ 
perature. This sensing modality has received little attention in the literature, yet 
it can provide information that cannot be obtained from vision or tactile sensors 
alone. Humans, for example, have little trouble distinguishing meLal from plastic. 
The great difference in their thermal conduction characteristics give the metal a 
distinctively cooler feeling. 

The thermal censor measures heat conduction by actively applying heat to 
an object, and measuring the temperature changes at, the sensor’s surface [Siegel 
and Simmons 1985]. If the material the sensor Is in contact with is a good heat 
conductor, the surface temperature of the sensor will rapidly decline. This, device 
u ecs surface mounted thermistors for temperature measurement and has a d x 4. 
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array of thermal detection cells. 

Since the potential usefulness oF sensors is heavily dependent cm their reliability 
sensitivity, and packageng, much attention is given to these considerations. A 
detailed set of performance experiments was conducted for both the tacLhe and 
thermal prototypes to fully quantify their capabilities. The motivation for the 
particular experiments chosen is carefully discussed, In current literature, sensor 
performance is commonly characterized lti an ad hoc fashion^ making comparisons 
difficult. 

The performance experiments conducted show that, the sensors can be used in 
a number of useful ways. The tactile device's spatial resolution is sufficient For 
identification of small objects by recording their contact profiles. Objects larger 
than the sensor can be characterized by a groping strategy, The tactile sensor can 
classify the contact type between an object and its surface; discrimination between 
point, line,, and plane contact is possible. The thermal sensor can identify materials 
in contact with its surface. 

A sensor equipped hand alone cannot perform useful operations. High per¬ 
formance computers are required for the computationally complex sensor-based 
control strategies envisioned. This thesis also discusses a multiprocessor based 
computational architecture suitable for these needs. The system Is based on high 
performance single board computers interconnected via a shared memory bus. 
Commercial products were chosen over custom designed hardware Ln reduce the 
system's development time. 

To summarise,, the important issues to be investigated in this project include: 

* Packaging: most devices do not have suitable packaging for installation on 
tbs Utah-MIT hand's fingers. Many sensors arc too large to fit within the 
tight space constraints at the mounting sites, and cannot bend around the 
curved surfaces of the fingers- 

* Reliability: many senwra lack the reliability needed for repeated use in actual 
applications. Much attention is given to construction techniques that insure 
a long mean time between failures, 

* Thermal capabilities: almost all prototype sensors, and all commercial prod- 
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nets, cannot sense the thermal properties of a mate Hal. Further investigation 
was warranted to determine this sensing modality's potential usefulness. 

* Benchmark testing: many research and commercial devices have not been 
adequately tested making it hard to determine their actual performance. 
By using a sensor test facility, detailed measurements are obtained, and the 
sensors long term reliability established - 

• Computational support; high, performance computer hardware and appro¬ 
priate software support must be provided for the sensor equipped hand. An 
architecture that meets the long term needs of this project has been designed 
and tested. 

These issues arc fully disCUS&ed in subsequent chapters of this thesis. Finally, con¬ 
cluding remarks on work in progress to fully utilise the tools described i.s presented. 
The Utah-MTT hand equipped with contaet sensors and a powerful computational 
architecture will he used to perform complex manipulatory operations that robots 
have never before been able to achieve. 
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The work presented waLhin this chapter describes a tactile sensor for use with t.he 
Utah-MIT four fingered dexterous hand. Much aT the development effort centered 
on Isolating duraEde materials, and finding the construction and packaging tech¬ 
niques that permit mounting the censor on the hand and reliably using it over an 
extended period of time. The following sections review past work in tactile sensing 
and describe the prototype’s design and performance in depth. 

2,1 Overview 

The potential usefulness of tactile sensors in robotics control applications as well 
documented in the literature [Overton and Williams 1981^ Harmon 19&S- Dario 
and De Rossi 1985], However, the number of robotic systems equipped with tactile 
sensors is surprisingly low. In fact, investigations oF how to process and effectively 
utilise such information are equally uncommon. The slow progress in this area Is 
generally attributed to lbe lack of sensors that have the spatial resolution, sensi¬ 
tivity, repeatability, durability, and packaging required for robotics applications. 
The last two of these criterion create the most important and difficult problems in 
sensor design, and are often ignored. 
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In. addition, the lack of suitable dexterous robots has slowed progress in tortile 
sensing applications. To Fully exploit the power of a tactile sensor a manipulator 
must have the ability to reposition its fingers in three dimensions, as does the 
TJtah-\!TT hand. The tactile senior, of COUITW, must he suitable for use with the 
intended robot; if the sensor ls too large or cannot conform to the mounting surface 
available, it is of no use. 

Commonly cited applications for tactile sensing include parts- orientation, adap¬ 
tive grasping, shape recognition, slip detection, and texture discrimination [Har¬ 
mon I0tB2j. Each of these tasks is difficult, if not impossible, to accomplish without 
the aid of touch feedback. Imagine performing a manipulatory task with your 
owrt hands covered with heavy gloves; the lack of tactile feedback in this situation 
severely hinders coordination. For these reasons, equipping the Utah-MJT hand 
with tactile sensors is considered essential. 

Both Binford [1072] and Harmon [lEJEi2 have speculated on the. performance 
needed for a robotics tactile system, Harmon's report presents the responses to a 
questionnaire on touch sensing. The respondents were asked what properties an 
ideal tactile sensor should have. Spatial resolution was suggested to be in the range 
of I -- 2 mm. The transduction matrix should have between £ X It) and 10 X 20 
elements. Sensitivity ranges of 5 —10 grams per sensor cell were given. Hysteresis 
was said to be “intolerable, 1 * yet skin like robber coverings were desirable. 1 

Harmon estimates that a touch seiisor for automotive assembly should have a 
12 x 12 array of force sensitive elements, or cells, in a 2.5 X 2.5 cm square area, 
giving an overall spatial resolution in the range of TO mm. Hysteresis should be 
lees than 5 percent, and a ivr-an rate oF 100 Herts should he achieved. Finally, he 
recommends a minimum Force sensitivity of 40 grams per sensor cell, 

ThflSfl figures are often cited, though little attention has been given to their 
validity. In actuality, no suitable manipulator equipped with a touch sensor has 
been available to test therm However, some general comments on sensor require¬ 
ments are warranted. To successfully evaluate the needs of a tactile sensor system, 
a detaited description of the planned tasks must be compiled. For example, if the 


iTtris is actually a contradiction. A later Motion, will diacusa the issue of fryaureflis in more depth. 
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sensor is to be used io detect the outline of small parts, the spatial resolution must 
he suitably denser On the other hand, if a sensor is to be used to detect slippage, 
spatial resolution is of ksj importance. Picking a scan rate of say, 100 Herts, in¬ 
dependent of application does not seem reasonable cither. Very high scan rates 
probably are needed for slip detection, while low Stan rates would be suitable for 
small parts recognition. 

Since the body of literature oil how to use tactile sensor data is so small, selec¬ 
tion oF the appropriate sensor requirements is difficult. As a compromise, it seems 
reasonable to make the device approximate a human ! 3 touch sensing capabilities, 
since out hand’s sensor driven dexterous performance is so good. .4 brief review of 
human touch sensing capabilities is presented for this purpose. 

Humans have four different tactile sensors, each with their own specialised 
functions [Ilallerbacb The Merkel and Ruffini receptors have some static 

touch response, while the Meissner and Pacinian respond better to- a changing 
stimulation. Two point discrimination is on the order of l mm, a reasonable goal 
to achieve for robotic devices. Texture detection is mostly an active process, where 
fingers are moved along a surface. In Lbis case, the Merkel, Meissner and Pacinian 
all contribute information. 

Each, tactile receptor’s response is controlled by both their structure and their 
placement within the skin |Fhtllips and Johnson 1981], The Meissner’s corpuscle 
responds to tangential stress, the Merkel responds to compressive stress indepen¬ 
dent of orientation, and the Ruffini respond to directional skin, stretch. Certain 
stimuli are detected by their mechanical interaction between the skin and the cor- 
pusde’s response pattern, Merkel ending?, for example, best detect the high stress 
patterns that an edge induces within the skin. From this wo can conclude that the 
ultimate tactile sensor might require more than one transduction technology, along 
with an appropriate skindike mounting medium. 

After selecting the sensor's performance requirements,, many engineering chal¬ 
lenges must then be addressed. The Space constraints involved with mounting a 
tactile sensor are often severe, and the environment under which it must operate is 
commonly harsh. The active surface must withstand repealed contact with mate¬ 
rials, and probably requires a convenient method for replacement when it becomes 
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WOrxi Of damaged, 1 The electronic and other delicate portions of the sensor must 
he protected from the environment, while simultaneously performing their sensing 
function. Clearly;, special attention must be given to the sensor’s overall packaging 
for these requirements to be met. 

Specifically, a number of design goals for the tactile sensor were established. 
These requirements come from both the special needs of the IJtah-MTT hand, and 
from what are generally felt to he desirable capabilities for a tactile sensor, The 
moat important specifications Include:: 

* An S x8 array with under 2 mm cell center to center spacing: This requirement 
LS motivated in part by the mfichanoreeeptor sparing of the human skin and in 
part by engineering constraints. Human tactile resolution is found to be On the 
order 1 mm Phillips and Johnson 1081|, approximately the same as the actual 
mechanoreceptor spacing. To approximate human performance a sensor spacing 
close to this level is desired. However, engineering considerations dLctaLe a slightly 
larger spacing, to permit fabrication of a working and reliable sensor in a reasonable 
time frame. The 2 mm range was selected as a compromise between these two 
factors. 

* A sensing technology that permits mounting the device on the non-p!anar 
surfaces- of the hand: Since the tactile sensor is intended for use with the Utah- 
M1T hand, and since the hand's fingers have curved surfaces, non-planar mounting 
is a critical design goal, 

* A low profile package since space at the linger mounting sites is at a premium: 
The tactile sensor must not interfere with the overall dexterity of the hand, Bulky 
sensors would reduce the fiflger'S effective workspace. 

* Small space requirements for the wiring and electronics needed at the fingertip 
site, Again, the tactile sensor must fit within, the small space available at the hand’s 
finger sites, 

* A compliant surface covering for increased prehension stability [Fearing and 
Ilollerbach 1984], Recent work in grasping has shown that the mechanical prop- 

*r!ie hunu akin is useful in these lespectfli, it is both highly -durable and regen^ra-tee •when worn 
or damaged, Although, at ttmea it too may not held up in the harsh onvLmnnitnte that some 
InaiiLpuLatur} 1 tasks retjuire. 
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erties of the finder's skin play an important role in grasping operation?. A soft 
material wiLJ give a plane contact, instead of Che point contact- that would result 
From a bard material, This yield? greater grasp stability in part From the; increased 
friction at the contact area, Brackett [1955] proposes using a rheological surface 
that molds around the object being grasped, again to increase a grasp's natural 
stability. 

One potential requirement that has been omitted from this list is the ability 
for the sensor to detect tangential force components. The sensor designed can only 
respond to forces normal to its surface. Thu severe shortcoming is dictated by engi¬ 
neering considerations; adding tangential force detection was determined to be too 
complex ta undertake at the current time. Unfortunately certain operations that 
tactile sensors should perform are harder ta do using just normal force detection. 
For example, detecting slippage in the most general case requires comparison of 
the tangential force component with the normal force component mads by contact 
point friction. 


2,2 Previous Work 

Many tactile sensor designs have been reported in the literature and a few have 
recently been made into commercial products |Daria and De Rossi Ogorek 

lt>S5; Harmon L9S2], However, none of the reported sensors meet the previously de¬ 
scribed requirements for the UtaJi-MIT hand. Problems with packaging, reliability, 
size, and sensitivity preclude their use. 

All tactile sensors must convert an applied force into a measurable electric 
signal, The design choice made is in how that conversion process is to be done. 
The most common technologies employed are based on optics, resistance, magnetic, 
or capacitance, This section discusses several research at]d commercial sensora (see 
Table 2.1) and briefly describes Lheir Functionality. 

2.2, 1 Conductive Elastomer Sensors 

Several experimental tactile sensors based cm a material's resistive properties have 
been developed including those of Purbrick [BPSl], Overton and Williams l9Rl| n 
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Table 2,Ii Summary research mtd ^miNirn'd tactile sensors. 


Year 

Device 

Size 

Spacing 

Technology 

1981 

Purhrick 

8 X B 

2.5 inm 

resistive 

1982 

Hillis 

19 X 10 

9.7 mm 

resistive 

1982 

ftaibert 

9x3 

1.9 mm 

VLSI 

1983 

Barry Wright 

19 X 19 

2,5 mm 

resi stive 

1983 

Haekwood 

7x7 

2 mm 

magnetic 

1983 

Nomura 

15 x 15 

2 mm 

optica] 

mi 

Hole 

8x8 

2.5 mm 

capacitive 

1984 

Chun 

8x8 

2 n'Lt n 

VLSI 

1984 

Dario 

8 x 16 

3 mm 

piezoelectric 

1984 

Jacobsen 

1 cell 

20 mm 

optical 

1984 

Lord Corp 

10 X 19 

1-8 mm 

optical 

1984 

Schneiter 

24 X 25 

0,4 mm 

optical 

1985 

Ten Grotcnhuls 

19 x 8 

1,5 mm 

carbon fiber 

1985 

Petersen 

3x3 

1.6 WITH 

VLSI 

1986 

C rahn 

3x4 

1 mm 

piezoelectric 


anil Hill is jltfcS 2|, The Pur brick sensor uses conductive strips placed at right angles 
to printed circuit board traces, where tactile cells are formed at each intersection. 
As pressure on the conductive strip increases, the contact resistance Formed with 
the circuit hoard trace, decreases. The device achieves a 3 mm centcr-to-centcr 
cell spacing. The QverLon ami WilLiarns sensor, based on conductive rubber plugs, 
achieves a 2.5 mni cell spacing. 

Fill Lie 1 device Is based on anisotropically conductive silicone rubber. This ma¬ 
terial is electrically conductive along one planar axis. As pressure is applied to 
the top oF the rubber, lLe contact with a bottom circuit board is increased. By 
measuring the resulting resistance, the applied pressure at a particular point in the 
array can be inferred. II ill is constructed a lb X 16 array of sensor points, with 1 
mm center to center spacing;. 

Barry Wright Corporation’s commercially available ScilaoElex tactile system, has 
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an 16x16 array with 3-S mm center to center celt spacing. The conductive eliStoiner 
technology employed within this sensor appears to be based on Purbrick design. 

A few sensors utilizing carbon fibers have been pursued [Larcom.be 1976; Ten 
GrotEnhuEg and Moore ISBfi]. Two sets of parallel caibon fiber iayers ire placed 
perpendicular to each other. As pressure is applied on the grid, the junction 
resistance between the upper and lower fibers decrease. 

Unfortunately, must of these sensors suffer from high hysteresis and low sensi¬ 
tivity. In addition, many have inadequate cel! spacing, thos’gh the Hiliis sensor hag 
achieved one of the highest spacings to date. 

£. £. S Sri id State Se nso ra 

Solid stale VLSI based designs aiiow small transduction cells to be integrated with 
the amplification and scanning electronics, and with low level data analysis hard¬ 
ware. Raibert and Tanner |19S2i have developed a VLSI tactile sensing computer. 
The chip contain? an array of force sensing cells, each with their own processor, 
Two-dimensional convolutions and serialization of the sensor data are performed 
directly on the device. However, the force sensing cells are not based fully on VLSI, 
Ins Lead they rely on a compressive resistive material placed over the package to 
transduce force changes to a measurable signal, 

The two most common fully VLSI based force transduction techniques utilize 
capacitive variations Chun and Wi&e 1985] and pie-zoresistlve changes j Wong and 
Van def Spiegel 19S5|. These sensors have silicone structures that respond to 
external force stimuli. The latter principle measures the deflection of a small 
silicone structure with an embedded pressure sensitive resistor, or piezoresistor. 
With, the former technique, a small diaphragm is constructed with an upper and 
lower plate. As force is applied, the diaphragm will contract, resulting In a change 
in capacitance between the plates proportional to the applied force. 

Transensnry Devices VLSI tactile sensor [Petersen et al. I985j, now commer¬ 
cially available, uses piezoresistive strain gauge based dement? ?paced approxi¬ 
mately 1.6 mm apart, in a 3 X 3 array. Each cell ha? a normal force range of 0 to 
90(1 gram?- A small pedestal placed on, each cell concentrates an applied force onto 
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the sensing site, improving the overall] performance. 

While VLSI based designs Rhow great promise, their current use in tactile seu- 
sors is limited by packaging difficulties. The integrated devices themselves are fairly 
durable, but fragile bonding wires must be brought out from the chip. In. addition, 
VLSI sensors are currently fabricated only on llaL surfaces, precluding their use on 
the curved portions oF the Utah-MIT hand’s fingers. 

S.2.S Piezoelectric Sensors 

Dario et ah [lftfid] describes a sensor based on poiyvinylidene lluride (PYFj] t a 
material that has both piezoelectric and pyroelectric properties- Pressing a thin 
film sheet of PVF* generates an electrical charge proportional to the applied force. 
In addition, the Dario sensor has a resistive based sensing layer to obtain static 
force measurements’ the PVFj only responds to changes in the force stimulation. 
The pyroelectric properties of Lbe material can be used to measure a material's 
thermal properties. The device obtains a 3 mm center-to-center cell spacing in an 
S x 16 array. 

Grahil and Astlc [1086 describe a novel sensor based on ultrasonic pulse-echo 
ranging. A sheet of piezoelectric film is placed under a layer of silicone rubber. 
Ifler.trodea are placed on the film at discrete points. To detect the applied pressure 
at a location of the array, the piezoelectric Film Ls excited. The vibration pulse is 
reflected off the silicone rubber surface, and it’s return is detected by the film. The 
elapsed time between the pulse and the echo la proportional to- the thick [teas of the 
silicone rubber at that point. While this sensor shows promise, the device has yet 
to made into a smalt array suitable for finger mounting. 

2.2.4 Magnetic Based Sensors 

A magnetic based sensor lias been proposed that extracts shear force as well as 
surface normal force (Hackwood et al, 1963]. An array of magnetic dipoles ia 
embedded I 11 an elastic medium, This rubber covering is placed over an array of 
magnetic field sensora fabricated in a altkone substrate. A pure normal force would 
increase ail the magnetic field sensors around the elastic, medium’s dipole evenly. 
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If a shear force were applied „ the dipole won Ed rotate and translate in the elastic 
medium. The rotation and translation can then He measured, by the variation in 
magnetic field in each of the cell’s sensors, 

Sensors of this type are Interesting because of their ability to detect, shear force, 
as well as surface normal force information. Most of the sensors described in the 
literature are unable to do this. However, the Hack wood magnetic sensor has not 
worked out well; the magnetic effects being measured are quite smalt, and hard to 
detect. In addition, the sensor is overly sensitive to extraneous magnetic fields and 
metallic objects. 


5.5.J Optical Sensors 

Jacobsen ct aL 111*84] discusses a fiber optical based tactile sensor that utiiiies a 
birefringent material. As farce deflects this material, its abltity to pass polarized 
light is reduced. An optical sensor measures the returning light, and converts it to 
an electrical output proportional to Force, Unfortunately, only single tactile cells 
have been constructed and It is not clear if the technology can be extended to form 
an array. 

Two commercially produced optical sensor are now available. An early Lord 
Corporation device [discussed in Ogorek 1985., and in Dario 1985) with an optical 
transduction mechanism has an 8 x 8 array with 7.6 mm cell spacing. As pressure 
on the sensor is increased, the deflection of its surface reduces the intensity of a 
light source. Lord’s latest optoelectronic sensor achieves 1.8 mm cell spacing with 
a. 10 x 16 array. The entire pad can be scanned in 5 milliseconds and its force 
capacity is 3 pounds. Begej Laboratories [Begej 10S4] makes a fiber optic sensor 
with 1,0 mm element spacing. The system images the tactile output by projecting 
the optical fiber output onto a solid state camera. Both these sensors are too bulky 
for mounting on the Utah-MlT hand. 

Sehnetter and Sheridan [1984) describe a silicone rubber based optical sensor, 
A reflective coating is applied to the underside of a silicone rubber sheet. A bundle 
of fibers project light onto the sheet, and receive the reflected light back. Pressure 
applied to the silicone rubber modulates the reflected light’s intensity. A video 
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camera is used to read the sensor 1 ;? output by imaging the fiber bundle. The device 
achieves a very high spatial resolution of 330 points per Square centimeter in an 
array of 34 x 35 sensor elements, 

An advantage of optical sensor designs is their relative insensitivity t.o electrical 
interference. Since the force signal is propagated from the sensor site to detecting 
electronics optically, noise Immunity is quite good, 


£.£.6 Capacitive- Sensors 

A capacitive based sensor measures an applied force by detecting a change in the 
separation of two electrically conductive plates. As the plate separation is reduced,, 
the capacitance between them increases, 

Bole fl3S4] describes a prototype sensor with an S X ceil array and 2,5 mm 
center-to-center spacing. The technology described in Hlh work is promising and was 
selected as a starting point for the design used within this report. The remaining 
sections of this chapter discuss capacitive based tactile sensing, and then describe 
the sensor design, construction, and performance in depth, 

2.3 Design Issues 

This section discusses the tactile sensors design. The transduction principles, the 
fabrication processes, and the scanning electronics are covered in depth. Attention 
baa been given to describe both the final sensor prototype and some intermediate 
devices. This approach gives a better feel for the difficulties encountered during 
the project, and bettor motivates the chokes made in the final design. 

The sensor described within this report is based on the work of Bole |1984]. 
Both sensors share the capacitive based force Lransduclion principle, described in 
Boie's paper. This work, however, investigates the use of improved construction, 
techniques to attain greater durability and to permit mounting on curved surfaces, 
uses different scanning electronics for improved performance and reduced size, has 
greater spatial resolution and sensitivity, and can be scanned at a higher rate, 
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3.3.1 Transduction Principles 

Two parallel electrically conductive plates generate a capacitance proportional to 
their separation distance. If a compressible dielectric material is placed between 
them* a force applied to the capacitors top will reduce the plate separation dis¬ 
tance, The resulting change in capacitance can be used to infer the applied force. 
This principle is the basis of the capacitive tactile sensor’s force transduction mech¬ 
anism. 

An array of capacitive cells is formed by sandwiching a dielectric layer between 
two sets of parallel conducting traces, with the top etches perpendicular to the 
bottom ones. A capacitor is formed each time an upper trace intersects a lower 
trace. To make an array of §4 force Sensing capacitors, -8 upper traces and 8 lower 
traces are used, 


S, 3.2 Fabrication Details 

As previously mentioned, the basic operating principle for the tactile sensors b 
the measurement of an applied pressure by detecting a variation in the gap of two 
parallel capacitive plates. Hence, the material between the two plates is a crucial 
component of the device; it forms both the elastic layer that, compresses in response 
to pressure, and the dielectric layer that provides the capacitance between the two 
plates. 

Ideally, this material should compress linearly as force on it increases. This 
spring-like behavior is given by 

F -= kAX, (*, 1 ) 

where F IE the applied force, k Is the effective spring Constant, and AX is the posi¬ 
tional change that Lhe force produces. Having a material that closely approximates 
this equation makes it easy to translate the output of the sensor back to the applied 
force, since the detected capacitance wit] then vary in, linear correspondence to the 
force, finis, the material selected should have linear compression over the range 
of pressures to be applied. 

The dielectric layer is composed of an electrically insulating silicone rubber. 
Silicone rubber has the desirable flexibility and durability that the layer requires. 
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In addition, its dielectric constant Is approximately 1, which increases the overall 
performance of the device by increasing each cell’s effective capaciLance, 

Although the silicon rubber is flexible, it does not have desirable continuum 
mechanical properties. In fact, it is largely incompressible when subjected to a 
uniform pressure applied over its surface. Since the tactile sensor detects act applied 
stimulus by measuring the resulting deformation profile that it generates, a solid 
object, pushing uniformly into the pad will not excite a response. The following 
paragraphs examine this problem in more depth, and explain the solution that ha? 
been employed. 

To better understand the behavior of the rubber medium, consider it to be 
composed of small unit volume cubes with jy? coordinate frames. Assume that the 
yz plane is aligned with the material^ surface, and forces arc applied along the x 
axis. The pressure applied to an axis of the cube is tailed a stress. A positional 
change resulting from the stress is called a strain. Stresses are related to strains 
by Hooke’s Law, where E is the modulus of elasticity. 

For the small cube, Timoshenko and Coodier |l951] gives the relationship be¬ 
tween stresses and strains as 

C I = £ — S (^ST + ff *)) 

£ u - if ( p s; ~ t 2 - 3 ) 

= 4 (*. -*(** + ^}) 


where a is the applied stress and t L3 the resulting Strain. Assuming the sensor 
uses a tllLil flat rubber sheet with its bottom glued to a rigid mounting surface, 
the y and s axis of the cube undergo hardly any positional change when a uniform 
preRSLire is applied to its Surface, That IS, the strains e v and f x are dose to zero. 
The tactile sensor measures an applied pressure by detecting the positional change 
in the i direction, which is given by e ± . Using these conditions the resulting t strain 


can be computed. 


First, we obtain the y 
mat el y hold 


and s stresses, Since the following relationships approxi- 
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which gives us 
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This result, indicates that Lbe tactile sensor would not detect the applied pressure 
at all, since no positional change is induced in the z axis. In essence there is no 
"'escape' 1 path for the rubber to take to relieve the applied pressure. The applied 
pressure is just converted into interna! stresses. 

Even if we. relax the uniform pressure to the yz surface assumption, using a 
flat, sheet of rubber causes problems. If a point pressure source is applied to its 
surface, complex positional changes in the x direction witl result, making it difficult 
to infer the actual contact profile. For example, material around the Contact area 
will bulge out of the sensor’s surface. 

To overcome this problem, wc have formed the elastic-dielectric layer into a 
sheet with protruding round tabs. As pressure is applied to its top, the tabs 
compress, and the material expands to fill the surrounding air gaps. Figure 2.1 
diagrams this layer. In essence, the tabs permit the material to expand in the y 
and x directions and allow compression in the X direction. 

Now there will be no stress in the yz plane, since it is all transformed into strain. 
This allows computation of the positional change in the x axis, that the previous 
stimulus will induce: 

= + (2.7) 

This Indicates that the tactile sensor equipped with rubber tabs can detect the 
applied pressure. 

Phillips and Johnson -1&81] discuss, the media norccep tors in the human finger. 
They found that apfene stress aseumption best fits experimental receptor response 
data. A plane stress model indicates that all strew is confined to the xy plane of 
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Side View Bottom View 



Figure 2-1: Etaftit-dielectric material. Rubber iais have been added 10 the layer i$ 
improve its etastomechankal propertied. 

the skin. Escape occurs along Lhe 2 axis. Adding rubber tabs to the tactile sensor 
makes it more closely approximate the human skin, in this respect. 

In addition, the pressure sensitivity of the device IS control fad. by the properties 
or the elastic-dielectric material. The stiffness of the Tubher, along with Ihs height 
of the. protruding tabs, play a role in the overall sensitivity and the pressure ranges 
that can be obtained. 

To obtain high sensitivity, desirable for detecting slippage and light contact 
forces, a low stiffness dielectric should be selected, Unfortunately, this reduces the 
dynamic range of the device. That is, the maximum pressure that the Sensor can 
handle before saturating is reduced.. To overcome this, it should be possible to 
form the tabs with two Layers of materials with different stiffnesses, as shown in 
Figure 2.2, When a force is Initially applied to the sensor, the Low stiffness portion 
of t.he tab compresses. As force Is further increased, the higher stiffness material 
begiiis to compress. For this scheme to work properly, the low stiffness material 
must go into non-linear saturation, when it HO longer compresses with increasing 
pressure. The graph shown in Figure 2.2 dlagrucns its expected behavior. 

The dielectric Is constructed SO each capacitor in the sensor array has a tab 
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Side View 



Compression Graph 



Mgure 2.3; Dual material dielectric layer. Ry farming the ela.Btie-dieler.lric layer with 
(it's trtufijriflf af varj/inj stiffness, it sAjuJJ be passible to build a ie«*pr uriift Iwth large 
dynamic ranje ctiii fetij/i &en$ilivity for small pressures. The graph i/voti's a plot af pressure 
against fiveraSl tab epiTipreairtdra. 


between it. Sines- the dielectric constant of air 3a lower than that of rubber, It is 
beat to place the tabs at the capacitor junction sites. The current dielectric ban a 
0.25 mm thick backing with the Labs protruding out from 0.2$ mm to 0.75 mm, 
depending on the desired force range. The Lab diameter is 1.4 mm. Experimental 
results determined that these values gave suitable performance for an overall device 
sensitivity in the 0 to 200 grama per square millimeter range. 

To form act array of capacitors, electrical traces are attached to the dielectric 5 * 
upper and lower surfaces, wiLh the upper traces placed perpendicular to the Lower 
ones, A capacitor is formed at each of the trace intersections. A thin layer of eEec- 
trica.ly insulating silicone rubber is placed around the device to provide electrical 
shielding. Finally, the sensor is covered with conductive silicone rubber to reduce 
external electrical interference. Figure 2.5 diagrams a trosR section of the device. 
The next few paragraphs discuss this design in more depth. 

The current prototype has $ upper conductive traces and ft Lower conductive 
traces,, forming 64 force sensitive capacitive cells. The scanning electronics dis- 
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Shielding 


Upper Traces 
Dielectric Material 


Lower Traces 
Mounting Surface 


Figure 2.3r Tactile sensor cross section. From top to Sn?Hern: upper conductive traces, 
elastic-dielectric molerial, lower comfucfctiie traces. The entire um'i 1'a covered with electrical 
shielding, 

cuSsed in the following section read fmcf values off the array by detecting each 
cell’s capacitance. 

The traces are made of an electrically conductive silicone rubber that bonds to 
the dielectric layer. The parallel trace paLicm is fiilk screened onto the dielectric 
layer. The Lower dielectric surface must first be made into a flat surface suitable 
for the traces. To do this, a thin sheet of electrically insulating silicone rubber 
is bonded to the bottom of the protruding tabs. The lower conductive traces are 
bonded onto this surface. Currently the traces are 1.27 nun wide, with 0.63 mm 
gap between adjacent rows. Hence, the capacitor plate area is 1,27 square mm, 
and the cenler-to-center cell separation is 1.9 min. 

The sensor must be shielded from stray electrical interference. Without proper 
shielding, the small capacitances that are to be detected at the trace junctions 
would be -swamped by parasitic affects. To do this, ths sensor package is covered 
with an electrically conductive material. Before this can be done, however, the 
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0,63 mm 
1.27 m m 


Lower Trace 



Figure 2.4: Pf.ttof.ypK tactile sensor packaging. The dielectric material is mounted onto 
4 priced cfVcwsi board. The hoard provides the lower (races. 

upper and lower traces must be covered with an thin insulating rubber layer, and 
Wires connected to live tracts must he brought out from the package. 

For initial testing of tho device, the upper conductive traces were, silk screened, 
to the dielectric layer and mounted onto a printed circuit board (Figure 2.4). The 
board provides the lower conductive traces. The sensor was then covered with an 
electrically insulating layer, and finally an electrically conductive layer to provide 
shielding. Photographs of various parLs of the tactile sensor arc shown in Figure 
2.5. 

The materials chosen for the various layers of the sensor were often hard to come 
hy, and had complex Interactions when Layered together to form the overall device. 
For example, placing certain silicone rubbers onto each other often interfered with 
their chemical curing process., preventing one of the Layers from hardening. In addi¬ 
tion,. not alt sllicOnc rubbers bond with eR.c.h other to being with. Ihaki Garahleta, 
a stall member at the MIT Artificial Intelligence Laboratory,, played a crucial role 
in locating these materials and in constructing the seirsor itself. His tremendous 
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Figure 2.5: Photographs of tactile sensor components. Top from left: printed circuit 
board, dielectric JnijirK tTivuj-riif from fai tide, dielectric layer and eppe-r conductive traces 
Bottom from left ; serwar ms-nnicd unfa ^rtniei ciVcait hoard with trace connections exposed, 
back wfiu of sensor and detection electronics. 

skill and craftsmanship made it a reality. 

2.3.S rJefcech'o-n £Jectronj'etf 

Before discussing the detection electronics, it is useful to estimate the capacitance 
of a senaor cell, Hopefully, itfl magnitude will he large enough to permit detection 
with, relatively simple eJectroEiies., keeping the size and cost of the sensor within 
reasonable limits. 
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Upper Traces 




Junction 

Capacitors 


Figure 2-fli (Jupttciiancc array schematic diagram. 


The capacitance of two parallel plates* in electrostatic units, ia given by: 


C - 


nA 

iTTtf 




where r is the dielectric constant of the separation material, and of and A are 
the aepajation distance and area of the two plates, respectively, If we assume 
d = 0.02& cm* A = 0,16 cm 5 , a dielectric constant of -1, and that the farad = 9>r JO 11 
electrostatic units* the nominal capacitance For a force cell is approximately 0.2 pT. 
Experimentally* the value was found to be closer to 0-5 pf, possibly due to a higlicr 
than expected dielectric constant. This is large enough to detect if ample electrical 
shield !or is provided to reduce external stray capacitance. 

Various techniques for measuring capacitance exist. However* not all of them 
are applicable for this sensor* since constraints exist on the interconnections be¬ 
tween the detection electronics and the capacitive ceils, This occurs because wires 
cannot be connected to both terminals of each force sensing capacitor. Thus, be¬ 
fore considering how to measure the capacitance of the sensor’s array of cells. Its 
effective schematic din grain must be presented. 

Recall the hasic deaign of the sensor. Its upper layer contains rows of parallel 
conductors, placed perpendicular to a lower layer of parallel conductors. The two 
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layers arc separated by the dsustic-dtekctric material. At each intersection of an 
upper trace and a lower trace, a capacitor La formed. The overall interconnection 
pattern results in the schematic diagram shown in Figure 2,fir 

This interconnection pattern constrains the schemes available for detecting each 
cell’s capacitance. One can readily see that each email capacitor cannot he con¬ 
nected to a detector alone. In facL, the best that can be done is to sdecL the row 
line and column line corresponding to the cell. The other cells connected to the 
selected row and column will affect the output value, The detection electronics 
must minimiM the effects of these other cells. In effect, the detection electronics 
must isolate each cell in the array from all others, when taking its reading. 

Before discussing the actual design chosen for the sensor, a review of several 
alternative methods may be instructive. Figure 2.7 diagrams several approaches 
for measuring capacitances Some of which are not applicable to the, sensor, but are 
interesting none the less. 

Circuit A diagrams a bridge detection scheme. Here, a time varying signal is ap¬ 
plied to the circuit, inputs, As the capacitor’s value varies, the effective impedance 
of one side of the bridge changes, affecting the voltage between Va. and Vi. A differ¬ 
ential amplifier can be used to detect this difference. The output of this amplifier is 
proportional to the capacitance being detected. Since a differential signal is being 
delected and amplified, this scheme has the potential for highly accurate measure¬ 
ments. Unfortunately, it cannot he used with the tactile sensor, since forming the 
bridge requires access lo boLh terminals or a cell’s capacitor. 

Circuit B uses the the resulting time constant between the unknown capaci¬ 
tor and a reference resistor, When a unit pulse is applied to the capacitor, the 
amplifier’s output wilt exponentially decay' with a RC time constant. Another cir¬ 
cuit, not shown in the schematic, times the decay and then, computes the value of 
C. Since C is quite small, the timing Circuit required must be fast and sensitive, 
complicating the detection scheme’s design. 

Another approach to measuring changing capacitance is based on charge con¬ 
servation. To understand how it works, the constituent equation for &. capacitor 
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Circuit A: 



Circuit C: 


C ref 



Figure 2-7; Methods for delecting tapAntance, 
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must be presented. 'Hie amount of charge a capacitor can store is given by, 


Q = CV> 


p-»i 


where Q is charge, C is capacitance, and V is the voltage difference between the ca¬ 
pacitor^ plates, As the distance between the plates is changed, the charge changes: 


i 


S.-V — 
dt dt' 


(£.10) 


Here, a current flow of i is induced as the capacitance changes. The voltage is 
assumed to he constant. 

This scheme la realized in Circuit C (Figure 2.7). Here, C itti varies, over time 
and C ri j is a fixed reference, Since C«j| and On/ are connected, the charge on their 
plates must be the same: 


T , dC *tii dQ dV orji 

in dt ~ dt~ Cni ~dT‘ 


( 2 . 11 ) 


Equation 2.11 holds because the input impedance of an operational amplifier can 
be made high, enough to neglect the current that would Row into its terminal. 
So, whenever the input capacitor's value changes, a proportional change in the 
output voltage is induced. Unfortunately, this method does not work well with 
kahy capacitor^ as the ones forming the tactile sensor are likely to be. Over time, 
charge will actually leak between the capweiLor plates, changing the output voltage 
appreciably. 

The detection method chosen for the tactile sensor is also based on circuit C. 
It's operation k similar to the previous, scheme, but overcomes the effects of leaky 
capacitive cells. Now the input signal V*, Is varied over time. If We assume C is 
fixed, and that V varies over time, differentiating Equation 2-9 gives 


i 


— = c— 

dt di 


{ 2 . 12 ) 


Mow, however, the current flow i varies continuously, Since the input signal Is not- 
constant. Since the junction charge 14 constantly changing, it k much less sensitive 
to capacitance leakage than the previous scheme, So, if I'Vn — smut, the circuit, 
output, is given by: 


V ml = • V, 


Cc$ll 

1 /l 


5 


( 2 . IS) 
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where C r4 f is the feedback capacitor selected, to give an appropriate gain. 

Equation 2,13 shows that the. output oF the amplifier is just a modulated version 
of the input, signal. To measure the capacitance of C.,^, the variation In amplitude 
of the sinusoidal output waveform is detected. First, the output waveform is pre¬ 
cision rectified.. In essence, its absolute value is obtained, Next, additional gain 
is applied, and low pass filtering converts the time varying waveform to a direct 
current signal with magnitude proportional to the root mean square voltage of 
the original signal, Conveniently, root mean square detector chips can be used to 
perform most of the detection electronics, greatly reducing the circuit’s complexity, 

To better understand the sensor’s performance, and to select the operating fre¬ 
quency for the input waveform, a more detailed analysis is needed. The frequency 
of the input signal affects the reactance (generalised resistance) of a capacitor. The: 
reactance of a capacitor is given by: 



where ui is the input signal frequency. From this equation we see that the higher the 
input frequency, the less reactance the capacitor has, and the greater the current 
Row through it- Since C M u ' a on the order of l.D pf, a relatively high frequency 
le needed to obtain even a small Current. Assuming an operation frequency of 
10OK hertz, the capacitor has an effective resistance of 10 megaotims. Since the 
operational amplifier input resistance sliouid be large relative to this, an FET input 
device and a high frequency signal should be used. 

The preceding assumption of infinite operational amplifier gain must be relaxed 
to fully understand the performance of this detection scheme, Since an amplifier 
has a finite gain-bandwidth product, high frequency input signals will result in. 
significantly lower amplification. If this is the case* Equation 3-13 will no longer 
hold. 

It is now clear that input signal frequency cannot be increased at will. It will 
eventually deteriorate the amplifier's performance. On the other hand, the input 
frequency cannot be too low, o-r not enough current will flow though the input, 
capacitor. To fully understand this tradeoff, however; we must consider the entire 
sensor in our model. 
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Figure 2 .S -2 Capacitance erraj seaunmj electronics schematic diagram. 


Tha effective schema-tic of the capacitive array is show in Figure S-d, A scan 
of the array should measure the capacitance of each of these cells. The scanning 
electronics must read each cell Individually, and must overcame the cross-talk that 
the interconnect pattern might cause. To do this, an amplifier is connected to each 
of the sensor 1 * rows, while an input signal is applied to one column at a time (Figure 
2.8], In a sequential fashion. Hopefully, the row amp'ifier outputs will correspond 
to the capacitance of the selected column 1 * cells. 

In Figure £.9 a more detailed model of the aenaor’s electronics Is presented. 
Here, the 7 capacitive cells in the column that are not selected are shown connected 
to the LLinpli Jler’s negative input, and are labeled The amplifier’s negative input 
is modeled as a resistor to ground, to indicate that, some current flows into It. The 
resistor if^rj models the sensed capacitor’s leakage. Applying KirchhofFVs current, 
law to the junction at the amplifier 1 ?: negative input gives. 




where G is the gain of the amplifier at the particular operating frequency, Is 
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R cell 


G ref 



V out 


Figure 2-9t IJetultil WKliifI of the tactile ee iu#r r a .icanmnd? tlcclrfy 


Hti-J, 


the effective impedance of the p&raJlel combination of the other capacitors on the 
selected column,, Z^ is the impedance of the amplifiers negative input, and Z,- rif is 
the impedance of the sensed capacitor and its plate leakage. The impedances are 
given by: 

Zjetl — R&aJ{3 U Ra*a C nU + l) 

z u - if. 


Zpp — Sjm 


Solving for V,^ gives 
V„ t = -V^GR,, 


ZW — 1/J l 


p jutR^uR^lCnjfj + C 1 ^ — c rt/ + + J£„ p 4- Rteti 

Since FET input amplifier are used, we can assume R yjJS Is very large: 


v;*4 = -V in G-r 


CetttRttG + 1 


[2.16) 


(2,17) 


'juR itU (C^G + C v - C ni 4- C' tu ) + T [2 ' 1 ^ 

Under idea! conditions, where both G and R^n are very large. Equation 2,16 

C„j, 


gives the desired result: 
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Figure 2-10; Graph of the T^r-lUe Senior’s Crosstalk Immunity with resptet to amplifier 
gam. C„ ranges from V pf to SO pf 


The effects oF pi ale leakage can be examined. using Equation 2.1S-, For large gain 
G, the magnitude of IS 


V „ = V, 

* UUli - * 3FI 


M 


chfRl 


+ 


c‘ 


ail 


< 4 / 


( 2 , 20 ) 


Fjrrars in the output signal occur when J}«j£ is targe or w is small. Hence choosing 
a large value for w minimizes leakage affectE. 


If we assume the drive frequency is high enough to ensure low plate leakage. 
Equation 2,18 gives us 


V 0M = -Vi, 


C r ,fG + — G rr j + Cr*it 


( 2 . 21 ) 


Ideally, should be independent of the capacitors that are not selected (CV). If 
we assume that C ce u has a capacitance of 1.0 pf, and C Tt p has a capacitance of 1.0 
pf t and Vm has amplitude 10, V oll [ should be 10. Any variation from this value will 
result in an erroneous measurement of the cell's capacitance. Equation 2.21 can he 
used to determine the gain required for this to be the case. 

The graph in Figure 2.10 shows the effects of G and C u on sensor output, as 
obtained from Equation 2.21. Sensor output is plotted against increasing gain. 
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Ideally, the output ahou.d be 10, and any deviation from that line is undesirable- 
Several curves are plotted for different values of C H , since its actual value depends 
on the force distribution on the sensor pad. The graph indicates that for gain over 
approximately 200, adequate performance is obtained. This limits the operating 
frequency of the input signal to the gain-bandwidth product of the amplifier divided 
by 200. Using this criterion, a driving signal of 20OK herta was selected for the 
prototype sensor. 


2.S-4 Dt3t$n Process Summary 

The device described in the previous sections required several design iterations 
before it resulted in a suitable sensor. In fact, the initial prototypes did not work 
at all. A brief review of Rome of the earlier attempts and failures at making the 
capacitive sensor will emphasize the most Important features in the final device, 

Vtrswn one, 1 the lower traces were etched onto a printed circuit board. Con¬ 
ductive paint was used to silk screen the upper traces onto thin rubber materials. 
Unfortunately, the electrically conductive rubber reacted with the elastic-dielectric 
layers that it was being applied to, and lost its conductivity. After several attempts, 
it was decided to apply the conductive paint onto a thin mylar sheet. This worked, 
but unfortunately mylar is not a flexible material. However, we used this sheet in 
the initial prototypes in lieu of anything else that worked. The elastic-did.eetrie 
materials used were very thin sheets of rubber. The motivation for this was that 
the junction capacitance would he maximized by a smalt plate gap. The electronics 
detection circuitry was fabricated On a wire wrap board, and the sensor was Located 
near the electrical detection components. This device did not xvork at all. 

Version fuw evaluation of version one's failure, indicated that too little attention 
had been given to parasitic capacitances. The detection electronics were located 
far from the capacitive array and the sensor itseit was not enclosed withm adequate 
electrical shielding. The next prototype was built with Onboard amplifiers, placed 
in close proximity to the array, Surface mounted components were used to minimise 
their elks. This worked, although the performance was not adequate. Performance 
problems included large crosstaik between sensor rows and poor response to an 
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applied force. 

Version three; small ground traces were placed between the rows to reduce the 
cross talk and rubber tabs were added to the elastic-dielectric layer to increase Ur 
compressibility. In addition, extensive electrical shielding was added to the entire 
package. The performance was .now satisfactory, approaching the established design 
gO*l. 

Vt rsion four; tlie mylar sheet with the upper conductive traces had to be elim¬ 
inated. This layer caused non linearities in the sensors force output and reduced 
overall accuracy. Since a smalt, variable, amount of air was trapped between the my¬ 
lar sheet and the elastic-dielectric layer, the actual din Lance between the-capacitor’s 
upper and lower plates was hard to control, After a lengthy search of materials, 
an electrically conductive silicone elastomer that bounded to the elastic-dielectric 
layer was found. This resulted in the device described iti this chapter. 

2.4 Performance Results 

A series of experiments was performed to quantify the tactile sensor's performance. 
The set of experiments selected Identify such criteria as pressure sensitivity,, shape 
discrimination, repeatability, stability, hysteresis, and interference i mmu nity Be¬ 
fore beginning to review the experimental results, a brief digression on the sensor 
evaluation process is presented. 

Erj.l Quantifying Stmar’s Performance 

It is easy to compare the performance of two stereo receivers. Over time, people 
have agreed upon a set of standard metrics that- allow contrasting different units. 
Such figures as “power output 11 and ^harmonic distortion 11 arc commonly used, 
Without a reasonable and agreed upon convention for these comparisons, it would 
be difficult to make relative performance statements about different models. 

Tactile sensor literature is plagued by a Jack of evaluation metrics. Because 
of this, it is. often hard to tell if a new sensor is really an advance over previous 
efforts. In fact, there is little agreement on any performance evaluation standards 
at all. Tor example, no standard metric for reporting a tmctile sensor’s pressure 
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sensitivity exists. When pressure is applied to a pad, should it he applied as a 
point source, or over a large area, or both? To make matters worse, researchers 
often fail to indicate how a particular test was applied, and report, for example, 
the sensor's output for a particular Force, giving no indication of how that force 
was distributed over the array. 

About the only metric that is consistently used is the number of tactile sensor 
cells in the array, However, this figure Is practically irreaninglesg. Ostensibly, the 
figure is reported as some indication of the overall spatial resolution of Lhe device. 
In reality, the spatial resolution is a complicated function of the cell density, the 
covering materials, and the scanning electronics, it would be useful to have an 
experimentally determined figure that- would overcome this problem, and convey 
mors useful information about the sensor's capabilities. 

The psychological literature can provide a useful starting point for ■quantifying 
sensor performance. Phillips and Johnson's [1081] have studied human touch sens¬ 
ing ■Extensively using a number of interesting tests. Specifically, they characterize 
two-point discrimination, gap detection, grating resolution, and letter recognition. 
While some of their procedures arc specific to human subjects, their methodology 
Le of general use for the development of tactile sensor lest standards. In addition, 
use of these tests would allow comparison of tactile sensors to a human’s touch ca¬ 
pabilities. Perhaps the most, important point to be learned from their work is that 
the design oF touch sensing experiments must be done carefully. Since complicated 
mechanical interactions between the skin, the mechano,receptors, and the testing 
apparatus occur, the set of experiments performed must be well thought out for 
their results to be meaningful. 

The following sections present not only a performance evaluation of the sensor, 
but discuss the significance of the tests themselves. Hopefully they provide a 
concrete picture of the tactile sensor's capabilities. Direct application oF the Phillips 
and Johnson studies has been omitted due to time considerations. 

To gather more accurate and complete data, a tactile sensor tester was devel¬ 
oped. The device, diagrammed in Figure 2.11, can apply a force accurately at any 
point on a tactile sensor pad. A stepper motor controlled xy positioning table moves 
the pad, and a stepper motor controlled linear slide mounted perpendicular to the 
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Figure 2.11. Tactile sensor tester, 

tabJe Applies the force. The three motors are under complete computer control, Tf 
a probe tip were mounted, directly on the S axis, a small position changes would 
produce A Large force increase into the sensor since the slide advances a relatively 
lar^e distances per Step. In effect, the granularity of forces that could be applied 
would not be adequate. To overcome this, a small linear slide is mounted onto the 
tester’s s axis and the probe is attached to the outer side of the slide, A spring Is 
connected between the t axis and the top of the probe. As the. probe, ls pressed into 
the sensor pad, the spring compresses, and the applied force increases, The linear 
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slide keeps the position of the probe aligned with the axis. To accurately measure 
the force being applied, the probe tip is mounted onto a load cell. The load cell's 
force output is sent to an analog to digital converter for computer processing, The 
experiments described In the following suctions were conducted using this device. 


S.^.S Pressure j.9cu.Sttil4iSy 

One of the most important performance criterion to establish is the sensor’s pres¬ 
sure sensitivity. In general, the sensor's response is affected by the applied force 
and the force distribution. UnFortunately, the response per force unit area k not 
invariant over the applied area. That is., as the area of an applied stimulus of 
constant pressure is changed, the sensor’s output aiso changes. 

The response variation due So stimulus size is due to both mechanical and elec¬ 
trical properties. JF the sensor were composed of discrete forec .sensing elements 
that have no connection to each other there would be no sizing affect. However, 
since most sensors have interconnecting components in them {an elastomeric cov¬ 
ering, for example), the mechanical connections becomes a factor. The sensor’s 
scanning eLecironics also play a role in its response. Hopefully the electronics can 
read a cell without, ambiguity. In some sensors, however, the values of neighboring 
colls car] have effects on eacll Other. 

The pressure sensitivity measurements obtained do not indicate the precision 
of the sensor. Instead, they attempt to capture the range of stimuli that the sensor 
can detect. This is usefui for evaluating such factors aa how light a touch can the 
device perceive, or how much pressure forces it inLo saturation. Since a tactile 
sensor is not necessarily used as a precise measuring device, this distinction is 
warranted. 

To teat the sensor’s pressure response, different probe tips with various contact. 
Surface areas were pushed into the pad. When a uniform pressure was applied, the 
sensor response was largely invariant over probe tip size. The rubber tabs in the 
Elastic-dielectric material arc responsible for this desirable behavior- 

figure 2.12 show the response of 6 tactile cells subjected to an applied force 
from 0 to 150 grama. A probe tip with 1.5 mm square area was used. The top 
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Figure 2,12 r Tactile senior jure^ati ri sonMiiviti/. 3 r op-: response of $ cells on wnrrt* 
ttfititnii. Bottom: response of 3 cells on nw row. 
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graph showg the response of a ceils along the same -column oF the sensor* while the 
bottom shows the response of 3 cells along the same row. Each row shares the 
same detection amplifier and each column shares the same applied input voltage. 
These plats show that the slope of Force response ig fairly constant in all cases* 
though Lhe output offsets vary. Since the variation in cell outputs are similar for 
both the row case and the column case* no conclusions can bo readied ou what 
sources contribute most heavily la the output variation. 

B-i.& Hysterttit 

Hysteresis plagues most sensors, particularly elastomeric based devices such as the 
capacitive array. The problem is exhibited by measuring the sensor output as a 
force probe is pressed and then released from its surface. The output while the 
probe force ig increasing differs from the output while the force is decreasing. In 
essence, the rubber dielectric expands at a glower rate than it contracts, when 
subjected to the same force. This is clearly a problem if the sensor is being used 
to accurately measure an applied force, since it introduces output uncertainty. 

In actualsty, hysteresis in tactile sensors may not prove to be as major problem 
as some researcher* have suggested. Human skin displays substantial hysteresis, yet 
our tactile sensing ability is well equipped to handle complex manipulatory tagks. 
In addition, a robotic system can compensate for hysteresis by recording the time 
history of the manipulator motion. Since the robot knows if its motion k causing 
increasing or decreasing force into an object, it can aelect the appropriate half of 
the hysteresis curve to translate sensor output into force. Even more importantly* 
hysteresis is probably unavoidable since tactile sensors must have elastomeric cov¬ 
erings. Previous discussion has established why a soft covering is so important. 

To examine the sensor’s hysteresis* a probe was pughed into- the center of one 
cell. The sensor’s output was sampled while the force was varied from 0 in 150 
grams* and then back to 0 grams. Since the speed at which the probe ls applied 
and then retracted affects lhe level of hysteresis, the force range was covered at 
several different rates. The plots shown in Figure 3,13 diagram the results of two of 
the trials. The upper graph corresponds to a force applied over a 2 minute Interval 





46 


Chapter £ Tactile Sensing 



Applied Force in Giatui 




Figure 2.1 3: Tactile sentor hysteresis, Top' forces applied over 1 mmufcc, Middle: 
forces applied over 5 mimitf-a. Bottom: forces applied iMJfx 10 mtnufsd 
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iv tills the lower graph was obtained over fi minutes. As expected., the Longer elapsed 
time reduces the hysteresis, 

S.4-4 Measurement Repeatability 

Tests were performed to determine how accurately it sensor can measure an applied 
force. The tester probe wan poked into a. capacitive cell a number of times, and 
the sensor’s output Was recorded. The output variance was used to compute the 
number of significant bits of force data that the computer was receiving from the 
pad. Repeated trials found that independent of hysteresis, $ bits of data were 
obtained. The actual uncertainty is larger if the force’s time history is unknown, 
since hysteresis is cm the order of 5 percent of the full scale reading. 

E-4-5 Spatial Selectivity 

The spatial resolution of the sensor is a function of the spacing between capacitive 
ceil centers and the elastomeric properties of the dielectric and protective coverings. 
Fur a seTvsor that records just surFace normal force, a point source should only be 
detected by the one or more cells directly in contact with the stimuli; spreading 
or blurring to adjacent ceils should be minimal. Obviously, having a sharp sensor 
response will give more detail in tactile force outlines of probed objects. In some 
cases, however, it may be useful to propagate strains between adjacent sensor sites, 
hearing and Hollerbach. |lfJB4| theoretically show how strain sensors placed below 
a surface can extract the angle of inc|ination, location, and magnitude of a load 
line. 

To measure the spatial selectivity of the sensor pad the tactile tester was pro¬ 
grammed to step linearly across the sensor pad and to apply a uniform force at each 
Location. The probe was advanced at 0.1 mm intervals and applied 100 grams farce 
at each point. One would expect that a ceil would respond best to a force applied 
directly at its center. As the probe moves further away, a drop in Output should 
be noticed. The receptive field of each cell is affected mostly by the mechanical 
properties of the rubber clastic-dielectric layer With the tabs helping to localize a 
celt's response. 
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Figure 2,141 Tactile Spatial Selectivity. Three curves sAeiu the response of sensor cells 
a£ a prole is applied to tile pad at 0.1 mm linear spaced intervals. The curves, from top to 
bottom., show the response of the S adjacent celts. 
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The plots: shown in Figure 2.14 EuuiTnarivse the rcRults of this test. The curves 
show the response of 3 adjacent sensor cells as a probe is linearly stepped across 
them. The peaks of the plots are spaced approximately 2 mm apart as expected, 
since this is the array's center-ta-center spacing, Notice that there is some response 
overlap between adjacent cells. That is, when probing on a cell, the neighboring 
cell will show some response as well- This behavior is desirable since it avoid* the 
dead xoncs between ceils that would otherwise result. 

2,4,6 Shape Discrimination 

The chape of an object can be obtained by pressing the tactile sensor against 
it, and recording the resultant force profile. In cases where visual inspection is 
Impossible, such as when a manipulator end-effector obscures the view, tills is 
especially desirable. The spatial resolution results of the previous section indicate 
that the censor's shape discrimination ability should be good. To verify this, small 
objects were pressed against the tactile: pad, and the force outputs were recorded. 

Since shape recognition litilixes. all fi4 tactile cells, a calibration procedure must 
be employed to normalize the array's response. That is, each cell should read the 
same value when equal forces are applied to them, Variations in cell Output wiLh 
an applied Farce occur for several reasons. A cell’s force response is related to Lhe 
compressibility of the elastic-dielectric material at its location. Small variations in 
the silicone rubber's properties cause differences hi compressibility at different pad 
locations. In addition, the scanning electronics themselves have smalt component 
variations, inducing differences in the force output of the cells. 

To calibrate the sensor the tactile tester apparatus was employed. The Lester 
was programmed to probe at the center of each tactile cell with a number of 
different forces. The actual applied force and the cell’R output were recorded for 
each measurement, A least equares procedure was used to lit a straight line to these 
data points. Table 2.2 shows the calibration data for one. of the sensor pads used to 
record the tactile images Bhown in this section. The slope and Zero force intercept, 
for each cell is given, Since a preceding section showed that the sensor's force 
response is linear, fitting the data points to a straight line is considered adequate. 
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Table 7-2- Tactile senst>t idttihilian Juts, The dope amf tuternepf of the c-cf-t eutpvi (o 
farce output curve. The upper valve in each box is the curve*» elope. The lower value ie 
the eutve'n tera force intercept. 


11.17 

9,20 

10,39 

11,43 

9-44 

9.62 

10.62 

12,62 

1170.11 

529.50 

984.66 

1059.87 

408.07 

667.39 

861.73 

1359.98 

10.46 

h.fifi 

10.18 

10.90 

8.87 

9.51 

10,51 

11,51 

1315.54 

739.62 

1358,97 

1306,69 

605.33 

849.42 

1111.26 

1616.56 

11.52 

9.76 

11,38 

11,99 

9.54 

9,92 

10,91 

12.63 

1556.75 

951.96 

1416,41 

1487.33 

730.60 

991,70 

1146.66 

1708.99 

11,84 

9.95 

10.14 

11.29 

0,18 

9.81 

11,05 

12.55 

1536.51 

900.59 

129D.99 

1306.79 

543,93 

834,14 

1 OH 1..4 8 

1637.00 

11-87 

9.78 

10.15 

11,02 

9.42 

10,34 

11 23 

13.,33 

1500.00 

907.85 

1232.46 

1249.29 

553.22 

873.16 

1146.05 

1650.53 

12.28 

10.08 

10.85 

11.41 

10,30 

10.90 

12.09 

14,23 

1640.94 

1013.30 

1403.50 

1340.25 

642.56 

990.80 

1153.65 

1610.83 

12.40 

11.20 

10.00 

12.20 

10.20 

10.94 

12,23 

13.76 

1608.85 

956.49 

1270.02 

1241,53 

622,25 

983.01 

1232-92 

1765.72 

11.19 

10.88 

11.69 

10,64 

8.53 

10,04 

11,01 

13,01 

1897,31 

946,76 

1304.00 

1139.44 

468.73 

061.06 

836.1 S 

1347.81 


The actual force output is obtained from a sensor's cell output from 

^ [ 2 . 22 ) 

where m ig the curve’s dope, 3 is the 55 e.ro force intercept* c eil( is the raw sensor 
output, and is the normalized farce. Notice that the values In each column 
of Table 2:2 are relatively constant. This occurs because each column Jias its 
own amplification electronics. Evidently the variations in the amplifier’s electronic 
components contribute heavily to the calibration difference in force output. 

Figures 2.15 through 2.23 show tactile force images. The data is displayed using 
three dimensional bar plots. The height of each of the 8x8 bars corresponds to 
the cell’s force output. Figures 2.15., 2.16, and 2.17 show force images of straight 
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Figure 2,15; Tactile f'majM af edges. Tap: aligned slightly off horUontal raiiV. Bottom: 
aligned directly on verttetiJ aits. 
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Figure 3.16; Tactile im&gta of t-dge*. I#pr afijiKd #n, a Js'd^aiid alia, ffo-fJcjnq,- aligned 
slightly &ff ha timtit af a™, 
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FE^urtf 3,IT: Tu. etile images of edge s. Top: aligned on diagonal axis, pressed «n"tA to 
forte, Bottom; aligned on diagonal aiis T pressed v'ith small force. 
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Figure 2.16: Tactile image vf integrated circuit socket. Top: diagram of socket. Eotltnn: 
tms.ji of socket. 
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Figure 2.1Qt Tactile of integrated circuit #ockc-t. Top: aligned on diagonal azt's. 

Bottom: ahgned ok opposite diagonal axis. 























56 


Chapter % To-cWe 


Side View 




3.26: Tactile image af part with friua edges. Tap. diagram of part. Bottom.: aide 
vf'cur image of pari. 
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~F1&utu 2.21: Tar.tift iWaf-c-s of port with two edges. Top: aligned on vertical (tits. 
Bottom: vilified right. 
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rigorc 2.22: Tactile images of bolt and washer. Top: itoit. Bottom: ii.tt*A*f. 





















Pr.rformnntt Results 


7,9 


Top View 



Side View 




Figure 113: Tactile imjfc of a MoUx connector, Top: diagram of etmnectoT, Bottom: 
tactile image. 
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edges pushed into the sensor pfui it different angles. Figures 2.18 and 2.19 show 
images of an integrated circuit .socket. Figure 2.20 and 2.21 show images of a fairly 
complex part with two parallel edges, one thicker than the ether. The actual gap 
between the edges is approximately 3 mm, corresponding to the 1 pixel gap shown 
In the image [sensor cells arc spaced 1.9 mm cenLer-to-center). Figure 2.22 show 
images of a bolt, and a washer. Finally, Figure 2.23 shows the profile of a 6 pin 
rriolex connector. In all cases Lbe variations in pixel height along an object’s edges 
come from variations in the pressure distribution as the object was pushed into the 
sensor pad. No special provisions were taken to insure that a uniform pressure was 
being applied over the part, 

$.4-? Interference Immunity 

It is important to insure that the tactile sensor will function in a variety of working 
environments. One problem with capacitive tensing frequently cited in the litera¬ 
ture is their sensitivity to external interference, In essence, parasitic capacitance 
Can interfun: with the sensor’s operation. To overcome this problem, the device 
constructed is extensively shielded; the entire sensor is enclosed wiLhin a grounded 
chamber. 

To test the array’s response to external stimuli, a series of objects were placed 
near it, without making direct contact to its surFace. The sensor output WB3 moni’ 
tor ad for any detectable variations due to these external perturbations. None could 
be found. The device’s shielding adequately protects it from external interference, 

2.5 Overall X>cvke Evaluation 

The beginning of this section discussed the lack of a set of common benchmarks 
for sensor comparison. This, of course, makes it hard for the results in this section 
to he compared with other works. However, a general discussion of how this tactile 
sensor compares with previous works is warranted. 

The sensor has achieved significant advances over Bole'S prototype tactile sen¬ 
sor. The ceil center-to-ccnter spacing has been reduced from 2.5 mm to 1.9 mm, a 
d2 percent reduction. The technology employed within the sensor should support a 
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further reduction of cell spacing to the level of 1 mm. Of equal; importance are the 
improvements to the sensor 1 !; packaging. The fully shielded integral silicone rubber 
package gives, the device increased sensitivity and reliability,, and permit mounting 
on curved surfaces. The use of tabs in the silicone rubber elastic-dielectric layer 
give much more flexibility in selecting pressure sensitivity than the nylon stocking 
used in. Boie’s sensor. Tlie scanning electronics have been redesigned to improve 
their performance, and reduce their size, to facilitate mounting the sensor in smaller 
spaces such as oil the fingers of the Utah-MIT hand. Finally, the sensor can be 
scanned faster than Bole's, at a rate of 500 frames per second. 

The primary design goal of making a tactile sensor suitable for use with the 
Utall-MIT hand has been achieved. The sensor can he mounted on the curved finger 
surfaces, and the Rise of the electronics is within the Space available at the fingers. 
The cell spacing of the current, prototype IS close to the 1.5 min ccnLer-to-center 
spacing that was considered desirable. 

Unfortunately* the sensor only responds to surface normal force, and not tan¬ 
gential force components- This will complicate certain tasks, such as slip detection. 
The sensor’s hysteresis might also be a problem since it reduces the overall sei^ 
eitivity of the device. The hysteresis problem may be overcome by employing a 
different elastic-dielectric material. Shear force detection, however, does not seem 
possible using this sensing technology. 

The sensor’s performance approaches some of Harmon’s goals. Tts cell spacing 
approaches the suggested 1,5 nun range, its hysteresis is near the suggested 10 
percent level, and its force sensitivity exceeds the 40 grams per millimeter recom¬ 
mendation. 

Future improvements planned for the device include a reduction in cell sise to 
the level of 1.2 mm cenler-to-center spacing, increasing the array size; to 16 X 16 
cells, and fabricating the detection electronics using hybrid Circuit construction 
technology. AH of these improvements should be possible without any major ad¬ 
vances over the Current prototypes. 
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A visual observation of a smooth sheet of red metal, a smooth sheet of red wood, 
and a smooth sheet oF red plastic would not uncover any major differences between 
them. After touching them, however;, it becomes clear that they are not the E-am-e. 
The inaLe-rials- will feel difFerent even if their surface textures are identical. It is the 
difference in their thermal properties Lhat allows ns to tell them apart. 

The human finger’s sensing abilities include more than just tactile reception. 
Clearly* metal feels cooler than wood and plastic. This sensation has nothing to 
do With the absolute tempera Lures of the materials; if they are in the game room 
they are indeed likely to be at the same temperature. The sensation is in response 
to the heat conduction properties of metal compared with wood and plastic. The 
finger is warm; a constant supply of blood acts as a heating source. When contact 
is made with a good thermal conductor such as a metal, heat, quickly Slows out of 
the finger. This reduces the temperature of the finger, and hence the metal Feels 
coot 

This phenomenon is explained by the second law of thermodynamics. When 
two materials are placed in contact with each other heat will flow From the. warmer 
one to the cooler one until their temperatures equalize. This heat flow cau occur 
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by three unique forms of physical heat transfer. Heat flow through connected parts 
of a body is called conduction,' heat flow through unconnected parts of bodies is 
called radiation, and boat transferred by the relative [notion of bodies is called 
conucctaW. 

The How of heat- in a thermal system is analogous to the flow of current in 
an electrical system, where a voltage difference induces a current flow, Voltage 
continues to (low between two points until the potential difference is eh ruinated, 

The robotic thermal sensor is patterned a Tier a human finger capabilities. The 
device should be able to distinguish materials by their thermal conduction prop¬ 
erties alone, by measuring the rate at which a mat.ena.1 can absorb boat from the 
sensor. 13y equipping a robot with an artificial thermal sensor, material classifi¬ 
cation that visual And tactile Sending cannot accomplish, will be possible, In the 
next section potential robotic uses for this device arc discussed in more detail. 


A.l Robotics Applications for Thermal Sensing 

An intelligent robotic system can exploit thermal sensing capabilities in a number 
of ways. For example, the material in contact with the sensor can be identified 
by measuring its thermal conductivity properties. If the materia] type is already 
known, the sensor output could indicate the roughness of the material's surface 
texture; a smooth surface would form better contact with the sensor^ surface, 
giving better heat conduction between them. 

A thermal sensor can also be used for extracting tactile like force response. To 
some ex tent, as the contact force between a material and the sensor increases, the 
rate of thermal conduction between them will, also increase. The actual materials 
used In the sensors construction affect the magnitude of this response. If the sen¬ 
sor is ultimately planned for material Identification, this pressure response should 
actually be minimized. These issues will be covered in more detail in the following 
section, 

A two dimensional planar array of thermal sensing elements will give heat con¬ 
duction images of contact regions. With this, the point of contact between a 
material and the sensor can be determined. Iss addition, objects composed of more 
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than one type of material can he: more readily recognized. The orientations of a 
writing implement composed of more than one material could be determined hy 
probing at several different locations and recording the types of materials found at 
each point, 

Crimson and Loza no-Peres l&Phj have shown liLat very few sensor data points 
from an object in three space are required for its unique identification. Their work 
concentrates on the constraints that tactile data provide. However., it would be easy 
to* extend the methodology to include other types of sensor information, including 
those obtained from thermal sensors. For example. If an object is grasped by a 
robotic hand equipped with tactile sensors., additional thermal sensors can further 
reduce the possible object orientations that are consistent with the overall sensor 
data. 

Equipping a robot wiLh boLh tactile and thermal capabilities wilt allow a more 
detailed study of human contact sensing abilities. The interaction between tactile 
and thermal transduction in onr Bfcm is not very well understood, and it le liltely 
that a complex interaction between the two gives rise to our perception of surface 
textures. To better understand how huntaus perceive and ufc contact sensing infor¬ 
mation, possible theories that attempt to mimic some of the biological operations- 
that the human system performs can be developed and tested OH robotic devices. 

When this project was first, undertaken, a literature search revealed only one 
reference to a thermal sensor [Dario ct al. HOST. Dario’s sensor is based on the 
pyroelectric properties of polyvinylidenc flnridc. Though his device is interesting, 
itis designed primarily for use as a tactile sensor, At the completion of this work a 
concurrent project conducted by Russell iOSaj was also reported in the literature. 
It seems that our independent efforts confirm the same result, that thermal sensors 
tan provide useful feedback information. 

3-3 Design of the Thermal Sons or 

To measure heal conduction, the thermal sensor combines an active heat source 
with an array of temperature sensors. The temperature transducers are mounted 
at the surface of the sensor, and record the temperature at the junction between the 
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Table 3,1: Thermal properties of muiei'iaii. 


Material 

K 

(Btu/hr ft F) 

c 

(Biu/lb F) 

fl 

(Ib/eu ft) 

cl 

(sq ft/hr) 

Air 

0.0 M 

0,34 

0.81 

0.72 

Aluminum 

117 

0.20B 

im 

3.33 

Asbestos. 

0.087 

0.35 

36 

0,01 

Brass 

50 

0.92 

532 

l.H 

Copper 

324 

0,01 

558 

4,43 

Lead 

30 

0.03 

705 

0.95 

W icke l 

34,5 

0103 

555 

o.eo 

R.u bh«.:r 

0-0*7 

0,4* 

75 

0.OD2 

S Liver 

242 

0.56 

655 

6.6 

Wood 

0.12 

0.57 

51 

0.004 


sensor and the material being sensed, If contact with a good thermal conductor 
is made, heal- will rapidly Flow from the sensor into the material, reducing the 
temperature at the sensor^ Surface, Tliu rate oF reduction in sensed temperature, 
and the steady state temperature that the sensor assumes* is related to the thermal 
conduction properties oF that externa! object. 

The following sections explore this basic transduction principle in more detail. 
First, a theoretical examination of the sensors performance abilities is presented, 
^ext, a discussion of the design and construction principles employed follows. Fi¬ 
nally, an experimental performance analysis is conducted, with the results con¬ 
trasted against the theoretic*! model of the sensor, 

tf.&f Th core tical A noiijeta of Sensor Performance 

To better understand the performance of the thermal sensor, a theoretical analysis 
of its behavior Is presented. A simplified model of the sensor and the material being 
sensed that captures the essential parameters that affect the system’s response is 
As we will later see, the actual output of the sensor closely corresponds to 
the results obtained in this section. 
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To formally classify & material’e thermal properties the parameters of con¬ 
ductance and diffueivity arc defined. The coefficient of conductance, K, relates a 
temperature differential to a heat (low, according to 

(a. i) 

where v is the temperature and X is the position along the material s axis. IhLs 
quantity captures the intuitive noLion that some materials conduct heat better than 
others; the higher their conductance, the lower the temperature difference required 
for a particular heat flow. 

A material’s diffueivity is defined to be 

K 


a 


pc 


{3.2] 


where K is its conductance, p is its density, and c is its specific heat. This parameter 
is related to the change in temperature of a unit volume as a unit temperature 
difference allows heat to flow into the objecL over a unit time interval. The units 
of w, square feet per hour, confirm this. Table 3,1 Lists the thermal characteristics 
of a number of common materials. The wide variety of values of conductivity 
and diffueivity for common substances should ensure different sensor responses for 
different materials, and hence allow unique identification. 

The thermal sensor is modeled as a block, and Lhe material being sensed as an 
infinite rod, as shown in Figure 3.1. We are interested in finding liie temperature 
at the boundary between the sensor and the material being sensed. This will model 
the experimental response of the thermistors in the actual sensor, Fne me .crioL in 
this section is developed from the excellent discussion of heat conduction problems 
i: (: T I aw [IMS]. 

The tempera Lure, t', of a block of material in one dimension, ie given by the 
diffusion equation 

■52-. i 3__ 

(3.3) 


d 7 v 1 du 
dx 1 ft d I 


where q is the thermal diFFuslvity of the material. To reduce equation 3.3 from a 
partial differential equation to an ordinary differential equation, we take its Laplace 
transform. 

r.-tHdt-ir = 


f ™ .i 




dl — 0, 


(3.4) 
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Sensor 


Material 


Figure 3.1: Thermal sensor model The block on the Uft represent* the sensor. The 
block fltt tAe W^t represents the material Aft'njj fr^-sed. 


which becomes 


d ! V 

fix- 


ft a 


(3.S) 


where F|j is the Lnitia] temperature distribution on the hue, which we assume to be 


zero. 


- ho So.. om::i;ion for equation 3.1, whir:: describes t • - iu.1 i.-rf.iLce 1.c i. v-.v cn 

the block and the rod., is given by 


hi rftl i ,-L 

Me -ft - 

at ax 


fl.fi) 


where ii(i) in the temperature of the sensor block t M is the mass oF tbs sensor, c 
le the specific heat of the EeriEnr, K IS the thermal conductivity of the material the 
sensor is in contact, with* and Q is the heat the sensor is producing- Intuitively 
this equation indicates that some of the heal produced by the sensor is absorbed 
by the sensor itself, and the rest flows into the material being sensed. Since the 
rod is assumed to be infinite in length., no boundary condition for the other end is 
needed. We can assume that at time t > 0, since the sensor makes good contact 
with the material, 

«{f)=n(0 1 t) t (-t-7) 

which allows us to obtain the Laplace transform of the boundary condition in terms 
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of v. 


dv Q 

MtS V (s) — K — = “ — M c Vo, at. rr = 0, 

fJj* a 


(3.8) 


We now must find & solution for v(s) which satisfies boundary condition 3.S 
and the Koverning equation 3-4, A solution that works is 


'W = 


QC 


+ 


Ve- 


where 


and 


Mcasr(r 4- A) or(r + A) 1 

K 


(3.0) 


h = 


Mca' 


r = —, 
a 


Taking the inverse Laplar.e transform of equation 3.9, we can obtain ti(i, f): 

2v'ar 


f .* 2Q I 'a* =d Qfl + M . 

* (M) = TV 7 C ’ ^(wrr) + 


+ ^ + + **>■ 


where er/r is the Gaussian error function, which is defined by 

2 


2 

erfc(a) - 1- -=. f e~* df>. 

j 0 


(3.10) 


(3,11) 


At the point rc = 0, the above equation represents Lhe temperature variation of 
the thermal sensor itself, 

<tw = w'jr-jk + +vj/*"«fe(fcv' 3 t ( 3 .i 2 ) 

From equation 3.12 we can. obtain the general behavior of the thermal sensor when 
it is placed in contact with a maLeriai. Since the cr/c function approaches scro 
rapidly* Lhe initial value of the sensor when placed in contact with an object will 
fall from Vq to 

2Q IT Q 

K V n Kh' * 3,13 ^ 

Figure 3.2 shows the hehavior of equation 3.12 as at and JVf are varied. 
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Fij^urt 1 .1.2: Rrhavipr pf Iks thermal sensor's governing t<fK<i.iwn. 
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3.8.8 Performance- Jsiuc-s 

The design of a thermal sensor is related to the thermal properties one is most, 
interested in sensing. This chapter will cover sensors that use heal conduction 
measure mm Is lor position localization, a nr: mace-ial ! .<h i'liib.ili..ii. 

Several factors affect the sensor’s ae curacy when used Tor material id enli float ion. 
Ideally, the sensed object should be in firm contact with the sensor. The heal haw 
from the sensor to the sensed object should be entirely unimpeded. This means that 
increased pressure of the Ranged object to the sensor should have a negligible effect 
on the rate of heat conduction between them. Tn essence, the thermal resistance of 
the gap between the sensor and the sensed object should be minimal. 

Selection of an appropriate; covering material for the sensor can RJisi@t. In achiev¬ 
ing good thermal contact between the sensor and an external object, A slightly 
compressible material that, conforms to the surface of an object seems ideal. If the 
material deflects substantially with pressure, however, the thermal sensor will have 
.; sign! I i caul pressure response. W hi In this would bo undesirable for material iden¬ 
tification, it does allows construction of a sensor with tactile response. The mare 
compressed the sensor covering becomes, the better the thermal contact between 
the external object and the sensor's transducers. Hence, the sensor gives a tactile 
pressure response. 

The covering material must also provide protection for the sensor’s transducers. 
The electronic components that measure the temperature at the surface of the 
sensor should be shielded from the damage that pressing the sensor against objects 
could cause. In addition, the covering must provide a surface that is adequate for 
the overall functions of the end-effector that it is mounted on^ while the sensor 
might be a device just used to gather exploratory information, It is mace likely Co 
be a part of an overall robotics system, and incorporated into existing end-eJTeetor 
designs. It will need to function not only as a sensor, but as the gripping surface 
for the robotic device. 

When selecting the covering material for a multipoint array sensor other issues 
must be considered. A material with high thermal conductivity will have the 
desirable property of conducting heat, in an unimpeded fashion From the sensor 
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to the external object, However, it may also he a good heat, conductor between 
adjacent censor pixels. This will, in effect, blur the reading? of nearby points, ar.d 
reduce Lhc overall spatial sensitivity of the sensor. 

To overcome this blurring effect,, it- is desirable t.o select covering materials that 
conduct heat best in t)]e vcrLical direction. Certain materials that we are looking at 
have properties that meet this requirement, including a silicon elastomer embedded 
with lateral conductive strips [Chomerks . Selecting very thin materials that are 
relatively poor thermal conductors may also help. While these material reduce the 
rate of heat flaw between the sensor and the sensed object, and hence reduce the 
overall sensitivity of the sensor,, they minimize blurring. .4 very thin material's 
lateral insulation effect won]d he minimal. 

The actual medium that the sensor's temperature transducers are mounted on, 
and the location of the active heat source, are two additional Important design 
factors-. The sensor transducers are mounted on k-uejlg material which, of course, 
conducts heat between adjacent pixels. In addition, the mounting material will act 
as a thermal reservoir, reducing the overall response speed of the sensor. 

When an object comes lit contact with the sensor, heat is conducted off hoth 
the temperature transducers and the sensor's overall packaging. The more heat 
Lhe entire sensor stores, t.he slower its response rate, Ideally, if the transducers 
were entirely isolated, and they supplied their own source of heat, contact with an 
object would draw heaL directly from them, and would be immediately measured, 
This section has provided information useful For constructing a thermal sensor. 
The Following sections discuss the scanning electronics and the fabrication process 
employed for tin; prototype device. 

$.£ r 8 Fabrication Details 

The thermal sensor uses thermistors for its temperature measurement transducer. 
Thermistors are semiconductor devices whose resistance changes with temperature 
according to the equation 

(3.H) 


/f,. - Rfi + 1* 
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Figure 3-3i pi-inted ctrcini board layout, The upper layer of the board is 

shown in solid littc.#, Each thermistor ts connected to an upper and lower trace. 

where /f, is the resistance at temperature t T F& is the thermistors nominal re¬ 
sistance, and is the coefficient of resistance with temperature. Typically, 

is approximately —0.04/C, giving a reasonable variation in resistance for 
small temperature changes [Horowitz i9Rf)|. 

Thermistors are appropriate for several reasons. Most importantly, they are 
available in small surface mount packages, allowing placement at dose intervals. 
Tn addition, thermistors have a relatively large variation of resistance wiLh temper¬ 
ature, greatly reducing the complexly OF the detection electronic, and reducing the 
device’s overa.l size, Finally, their linear response curve simplifies the calibration 
procedures required. 

A 4 x 4 array of thermistors, providing 1 fi temperature sensing dements, is 
attached to a flexible printed circuit board. The thermistors are placed 3,5 mm 
apart, giving the sensor a 1Q.S square mm area. Use of a RexLble printed circuit 
board allows the sensor to be mounted on curved surfaces such as the fingers of 
the Utah-MIT hand. Each thermistor must be connected to a row conductor and a 
column, conductor to allow the cell to be scanned by the detection electronics. The 
Lop surface of the circuit board provides the upper conductors, while the bottom 
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Figure 3.4: Photographs of the thermal ffemjor Left; exposed new of the thermistor# 
attached to the flexible printed circuit t^ard. Right: men? after thermally conductive covering 
has been applied, 

surface provides the perpend Leu Jar lower traces (see Figure 3.3). The thermistors 
are attached to the circuit board using either solder or a- conductive glue. The glue 
is somewhat easier to apply to the small devices, and provides an adequate bond. 

A photograph of the exposed thermistors attached to the flexible printed circuit 
board is shown in Figure 3-4. To smooth the snrface of the device and fill the gaps 
between the discrete thermistors,, a layer of thermally conductive silicone rubber is 
formed over the entire surface of the board. This not- only protects the thermistors, 
but it averages out the temperature response between the gaps present in the 
thermistor array. The lower photograph in Figure 3.4 shows the scEfcSOr after the 
conductive rubber has been applied. The electronic components sfifin in the picture 
are for the detection electronics of the tactile array which 5a to be mounted above 
the thermal sensor in the near future. 

The thermal sensor’s heat generating source is placed behind the flexible printed 
circuit board. The heater uses an electrically conductive paint to provide resistive 
heat. Wires are attached to opposite sides of a layer of conductive paint, giving 
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Thermally 

Conductive 

Covering 

Thermistors 
circuit hoard 


Heating 

Source 


i 1 g.urc rfeffjiiaJ’ sensor -c ross st c u on. from lop to taHorn: ikermoSly protective 

covering, fAermisItfrSj flexible, printed board, etectrirat shielding, heating pad. 

a uniform current flow, and hence providing uniform warmth. The heater cannot 
be mounted directly onto the hack of the circuit board, since it would short out 
the conductive, trace!?- Instead, a thin layer of electrically insulating but thermally 
conductive paint is applied between their two surfaces. 

To summarize this sec Lion, Figure S.h shows a cross section of the sensor, The 
top layer of thermally conductive rubber form the semsor^ outer covering. Next 
come the thermistors, attached to the underlying iiexible printed circuit board, 
The back of the board is covered with an electrically insulating paint. Finally, a 
resistive paint is. applied over this covering ho provide the heating source, 

S.S-4 Detection Electronics 

To minimize the number of interconnection wires that are needed Go drive the 
thermal array, and to detect the resistance of each of the thermistors, a matrix 
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Figure A. 6: Ttarm-sf arroji canning flrdniiKl, Top; overall schematic of Ike thermistor 
a^raji and the multiplexing and detection electronics. Bottom,' effective wften- one 

ctf/titfLjt hae been, selected. 
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scanning approach is employed. Only one wire for each row and each column of 
the sensor is needed r For the 4x4 sensor, this reduces the number of wires required 
from 32 to S, and is obviously desirable. The overall electrical schematic for a 4 X 4 
array is shown in the upper diagram in Figure 3.6. Notice that one terminal of each 
thermistor is connected by parallel wires and that the other terminal is connected 
by a perpendicular set of parallel wires. This interconnect scheme catl easily ho 
realiied with a two sided circuit board. 

It is possible to isolate the resistance of any of the thermally sensitive resistors 
in the array. To read the value of a particular transducer, the column that it is 
located On is selected with the column select demultiplexer. This will apply a fixed 
voltage to that, column, and tie the other columns to ground. The rows of the sensor 
are connected to amplifiers in an Inverting amplification eon figuration. Since tile 
positive input of each of the amplifiers, is Lied to ground, the negative input will, be, 
in effect, at a virtual ground. This allows the resistance of the selected thermistor 
to be read without ambiguity. 

Figure 3.6 shows the effective schematic when a particular column of the senior 
is selected. From this we see that only that, particular column of thermistors can 
have an appreciable effect on the row arnpliTier’s output. Since the negative input of 
the amplifier is at a virtual ground, each of the unselected thermistors are effectively 
tied to ground and no appreciable current can flow through them. The resistance 
of the thermistor is obtained from the output of the op amp, and Is given by the 
well known equaLion, 

where R itn , ( ti is the resistance of the selected thermistor, and R„; is the op amp 
feedback resistor. 

In selection of the nominal resistance values for the thermistor it is important 
to consider their self heating effects. The thermistor will generate a detectable 
amount Of heat How if its nominal resistance is to-n low, which can interfere with 
the sensing process. Hence, the nominal resistance of the thermistors should be 
high, For our prototype, 5000 ohms was chosen. 

By self heating the thermistors it is possible to eliminate the need for a separate 
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heating layer. If the resistance of the thermistors are low, the current flow through 
them will generate heat. The scanning electronics: could he modified, to maintain a 
constant voltage across each thermistor hy regulating the current flow. The current 
flow itself would be used to determine the heat conductivity between the sensor and 
the sensed material. Unfortunately,* small thermistors with a low enough nominal 
resistance to generate an appropriate level of self heating were not available. Since 
the performance of Lire sensor would be severely diminished by reducing it3 heat 
output,, a separate heating layer is required. 

,3.3 ExijeriirLent.nl Result 

To evaluate the performance of the prototype sensor a series of experiments were 
conducted using the previously described 4 sc 4 thermistor array. The tests inves¬ 
tigate the sensor’s sensitivity, repeatability, response speed, and spatial accuracy. 
For each of the experiments, a graphical representations oF the sensor output plot¬ 
ted against time is shown. 


S.S.l Material Identification 

One of Che primary uses for the thermal sensor is recognition of an unknown mate¬ 
rial from a library of thermal profiles. From the previous discussion we can expect 
that the temperature aL the surface of the sensor will drop at an exponential rate 
when placed in contact with an object. The shape and flnai value of tills- curve, 
as we now know, is related to both the difTusivity and conductivity of the sensed 
object., in addition to characteristics of the sensor itself. Material recognition can 
be established by matching the sensor’s response to a library of response curves, 
where el good match constitutes Identification. 

To measure the sensor’s effectiveness in distinguishing among different objects, 
the following experiment was conducted: a number of objects were placed in con¬ 
tact with the sensor, and the temperature over time response was recorded. Figure 
3..T shows plots of the response of one sensor pixel afLer contact with the materials 
have been made. The sensors temperature response to wood, aluminum, steel, and 
brass is shown to differ significantly enough Lo distinguish among them. Though 





§3.3 Experimental Result 


70 



Figura 3-7: TVicrPiaf sr*iaar response ti? Mrt'dHa materials, Top. retpwwc for u;<jcd, 
fliKnjmum, and steel. Hatlom: response for aluminum and 


the elapsed time shown on the plot is fairly long, positive recognition can be ac¬ 
complished more rapidly. The temperature curves separate from each other after 
only a few seconds. 

Figure 3,8- shows the temperature response profile for aluminum over a long 
Lime period- It takes over 200 seconds for the sensor to reach Its steady state con¬ 
dition- Notice that after 2o(] seconds, the sensor’s temperature Starts to increase. 
This behavior was predicted in the theoretical model developed previously. It 
should be possible to obtain an unknown material's thermal parameters by fitting 
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Figure S.B: Thermal steady aide re-spanse carve for ft/mstnuro. Over £00 seconds ore 
required for aluminum to reach if 5 steady state ttmptratmre. Notice Ifiat the senaat ^ tem* 
pcwiiKi-H starts to tftcrftIM, 

a theoretical response curve to the sensor’s output.. 

It should be noted that the surface texture of a material being sensed affects 
its overall thermal profile. This interesting result is caused by variations in the 
quality of the thermal contact made between the sensor and the sensed object. 
A rough texture has many gapa in its surface. The gaps are filled with air, and 
form a thermal insulation layer between the sensor and the object. Since material 
identification is made by comparing a thermal response curve with a library of such 
curves, this effect should not cause problems with the sensor’s operation. In fact* 
the ability to distinguish a rough finish from a stciooLIl finish could be an advantage 
in some situations. 


$.$.£ Measurement Re;*ai(ibiltty 

To successfully identify a materia] against a library of thermal response curves, the 
sensor's measurements sliould be repeatable. To test this, an aluminum block was 
repeatedly placed on ihe censor., and the response curves were recorded. Figure 
3.9 shows several of these plots. While some variation in sensor output over time 
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Figure 3-9: TKcrrual jenser rfp™ia.!?a'h7jr. The euree-s f&e .sifntfi/r’iT re^pen-yc (if 
CGitlact iui(A the same bloek of aJiiwu'flitttJi Jukj'hj S fra'iita. 

is? present, in general, each of the trials produces similar results. 

It should he noted that the materia] was placed on the sensor in a somewhat 
haphazard manner. For example, no special setup was used to ensure constant 
pressure from triaJ to triad.. This should be similar to the sensor's actual operation 
conditions. 


3.8.$ Variation in Heat iDtdpii? 

The previous experiments were performed with the sensor generating a fixed amount 
of heat. In particular, 0,5 Amps oF current were running through the heating 
source, generating P.3S watts of heat output. To determine the efFecLs of varying 
heat produclion the sensor response at three different heat levels was monitored. 
A piece of aluminum Was placed in contact with the sensor generating O.OSt 0,38, 
and 0,R-1 watts of heat. From the plots in Figure 3,10 one can see that increases 
in heat output give larger variations in the sensor’s thermal response,, while the 
general shape of t.he curves do not change. From this we see that increased heat 
production gives the sensor greater sensitivity. Of course there are limitations on 
tbfi operation temperature of the sensor; for example, too high a temperature could 
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Figure &.1U: Tftermai variation in ftrai oufptii!. The fitra* thaws ike temperature re.- 
apiynsc profile for 4 fi 0 c.fr i?/aJurtaittutn while the heat generated by the s-msor is varied. One 
fan set ikoi a higher Acai gives the senwr a larger dynamic range. 

damage the sensor or the object being sensed, 

S.S.4 Thermal Temperature Rettevery 

When a material is removed from the sensor, some time is required for the sensor 
to return to ELs steady state temperature. To determine this recovery time, a h3oc.lt 
of aluminum was placed in contact with the sensor, and then removed. Tlse tem¬ 
perature profile of the sensor was recorded during this experiment, and is shown 
in Figure 3.11. From this we can see that S-0 seconds elapsed for a 90 percent tem¬ 
perature recovery. This k rather slow. However, it should be possible to reuse the 
sensor before full temperature recovery. In Figure 3.10 thermal profiles are shown 
for the same material with the sensor operating at different initial temperature?. 
The general shape of each of the curves is the same; the variation that occurs is 
just in the sensor's initial and final value. From this, we can conclude that it is not, 
important for the sensor to operate at. a constant temperature. 

If Faster temperature recovery was felt to be important, the lieaL output Could 
be varied, By increasing the current flow through the heating (ayer, additional 
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Figure 3. LL‘ Thermal temperature recovery. After an abject is ttm^ved ftam CcuidcJ wiEft. 
the sensor a finite time it required for the ji< 4 of r s letttjfcrctiir.r to rclum tt? hs steady ii-aie 
r-'afrfff. In the first phase of the graph, a material is in contact uietfe the st.neor. When the 
iemptafsirTf reatheg 1(3 foment point, the object has been removed, and temperature recovery 
brains, 

Il^sLL could be generated on demand, Tn addition, the sensing Scheme utilizing 
self heating of the thermistors would speed the recovery process, Here, the sensor 
attempt^ to maintain a constant; temperature at the thermistor sites as part, of the 
measurement process.. 


S. S, 5 Press ere Efficc is 

As pressure between the sensor and the sensed object is increased, the thermal 
contact between them also improves. This effect allows the thermal sensor to he 
used for tactile perception. As pressure is increased, the rate of heat flow from the 
sensor to the sensed object increases, Of course, this effect makes it harder to do 
absolute material type identification. If the contact force is unknown, or the Force 
is changing over time,. the effects due to material type will need to be isolated from 
the effects due to the contact pressure. This could be ascertained, by giving the 
robot both thermal and, tactile sensors. 

Figure 3.12 show the sensor output for aluminum pressed into the sensor with 
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Figure 3.13: Thermal pressure response variation. The upper 3 curves show the response 
for alumin im as it if pressed siiffl the sensor at different forr.ss. For refers muf, the faivtr 
C rernr aiciBUl the rc.sp<J nsc for hritss 


3 different forces, The applied forces range from 1 to 2 pounds. For reference!, the 
lower curve shows the response for brass. Notice that there is a significant difference 
between all the aluminum responses and the brass response. This indicates that 
even if the applied pressure is unknown, an adequate difference in sensor output 
exists to distinguish between those two materials. 

This version of the sensor uses a covering material that attempts to minimize 
the effects of pressure on thermal response, The response variations detected here 
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are considered undesirable;, sines we designed the sensor for material identification. 
For tactile applications, a more compressible surface covering could greaLiy increase 
its pressure sensitivity. 


3.3.t> Spatial Selectivity 

The pise! grid of the AxA version of the sensor gives thermal conduction “images* of 
an object. This information can be used to determine a material 11 s spatial position, 
as well as its heat conduction properties. To visualize the data gathered by the 
array, three dimensional plots of Its output are shown. The better the thermal 
conduction of a point, the larger its z value on the plot. In Figure 3.13 the response 
■of the entire sensor pad. as it is probed with an aluminum and wooden rod is shown, 

&,4 Combining the Tactile Sensor and the Thermal Sena nr 

The tactile and thermal sensors previously discussed provide useful contact sensory 
feedback information. Ideally, a sensor could be designed that incorporates both 
these modalities into one device. This section briefly discusses the modifications to 
the tactile sensor and the thermal sensor Lhat would be necessary io achieve this. 

3.4-1 Performance Issues 

Merging together the capacitive based tactile sensor and the thermistor based ther¬ 
mal sensor is relatively straightforward. Since the tactile sensor requires mechanical 
contact with th& material being sensed,, it should form the outer surface of the dual 
modality device. The thermal sensor reliea upon the conductive transfer of heat, 
and will work when placed below the tactile device, 

Stacking the tactile sensor above -hr. thermal scji--:r has *.::c '.mdesiTable <-fiwr 
of increasing the thermal mass of the overall device. The analysts of the thermal 
sensor's performance indicate that the mass of the sensor plays a significant, role in 
the performance and sensitivity that can be obtained. Lower sensor mas-s increases 
the rate of temperature rolloff and hence decreases the response time required for 
characterizing the sensed material. 
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Figure 8,i3l TAeriJinf spatial selectivity, Height c/ bar indicates level af thermal can- 
rfiiaiiflitjr at that paiftt Tspr acnJael a rauni aJu^i'rann? rad. conlmt vtilk 

both a wooden rod an if an- olunuiMi-in rod, 
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The real problem with increasing Che sensoris mass is that its heat capacity 
also increases, To improve the performance of Lhe tac.ti le-thermel device, materials 
that. minimize the overall heat capacity should be selected. To do this, the capaci¬ 
tive sensor should be constructed with thermally conductive components whenever 
possible. 


$,4-2 Potential Sensor Construction 

The tactile-thermal device is constructed by overlaying the thermistor based ther- 
mil sensor above the capacitive based tactile sensor. Figure 5.14 shows a cross 
section of the the entire device, and indicates the functionality of each surface. 
The lowest layer is a protective baching and mounting surface. The thermal sen¬ 
sor's heating supply is placed between that layer and Idle backing oF the thermal 
sensor’s printed circuit board. Next, the thermistors are mounted onto the top of 
the circuit boards, and a layer of thermally conductive silicone rubber is molded be¬ 
tween them. The tactile censor is mounted onto this surface, The lower conductive 
strips that form the force sensing capacitors are applied to this surface. Electrically 
conductive silicone rubber is used for Lhc plates, and is deposited directly onto the 
upper surface of the thermal array. Next, the elastic-dielectric sheet is bonded onto 
the surface with the upper conductive traces applied to its surface. Finally, a layer 
of electrically insulating and then ele-ctrically conducting silicon rubber encases the 
sensor. 

The materials used in LHe combined sensor should be selected according to the 
previous sections discussion. The elastic-dielectric material, for example, should be 
made of a thermally conductive material. Since this layer is rather thick compared 
with the rest of the device, it could form a thermal barrier, reducing the thermal 
sensitivity. 

Since the materials to be used within this device Is similar to those required for 
the individual tactile and thermal sensors, one would expect that its performance 
and ease of fabrication would also be similar. In addition, it is not much larger than 
either of the previous sensors, making it suitable for mounting on the I.'Lab-MIT 
hand. 
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Figure 3,14; Tactile aa<f therjaal xmaar crnxx abelian. 
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The preceding chapters of this report have described two contact sensors suitabic 
for use with the Utah-MIT four-fingered dexterous h?,nd- In the near future they 
will be mounted onto as many as twelve surfaces of the hand's fingers, permitting 
detailed investigation of sensor driven control strategies, Imagine the wealth of 
data that will be available from these devices; clearly ample computer power to 
process the sensor information in real-Lime must be made available to fully reap 
the benefits that they will bring. 

This chapter describes the primary components of a computational architecture 
with performance capabilities that meet our sensor baaed control requirements. 
Most importantly, the system provides adequate processing power, flexible soft¬ 
ware development tools, and operating system primitive; appropriate for control 
programming. 

Conventional hardware and software configurations will not be adequate for 
the. computer requirements of the hand. Controlling a dexterous robot is a highly 
complex computational task in itself. The Utah-MIT hand’s 16 degrees of free¬ 
dom and it’* 32 eleetropneumatie actuators pose an even greater challenge; the 
high speed of Lhe specially designed, actuation system requires servo iaop rates in 
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excess of 500 cycles per second. The additional com pula Lions that sensor driven 
control strategies will add complicates matters. and further Increases the computer 
requirements of the overall system. 

The flavor of this chapter is practical in nature- the work was initially motivated 
hv the impending completion of the Utah-MiT hand* and the Lack of a computer 
system powerful enough to Support its control. This chapter’s title, however,, may 
be somewhat misleading in that the information is not specific to the control of the 
sensor equipped hand. In fact, most robotic controllers would benefit from design 
strategies similar to the ones described here. 

The work described in this chapter is part of an ongoing development effort 
to provide computer hardware and software suitable for robotics real time control 
applications. Sundar Narasimhan has played a key role tn Lhis effort and a Forth¬ 
coming joint publication will fully describe the details of the system. This chapter 
just presents an overview of the system's key concepts. 

In the next sections, general design principles, and specific hardware and soft¬ 
ware implementation details are covered. The chapter concludes With some pre¬ 
liminary performance and timing results, 

4.1 Design Methodology 

Time was perhaps the inosL important constraint on the potential system’s de- 
si gn. The in Lent of the project was to control a sensor equipped hand f and not. to 
design the ultimate Ln computational architectures- Second to this, flexibility to 
accommodate various software strategies and future hardware enhancements were 
considered important. These two principles helped U£ realize a powerful system 
suitable for controlling the hand in a modest time period. 

An early decision was made to use off-the-shelf hardware whenever possible. 
Custom computer hardware is usually not cost effective when only a few systems 
are to be built and when the computational requirements are suitable for general 
■purpose computer architectures. In addition, keeping a custom built system at the 
state of the art requires constant improvements in the hardware* a never ending 
proposition. Since commercial companies specialize at this, it is silly for a research 
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group to compete with them, 

An initial examination of the types of computations that are t.g be performed 
indicated that multiprocessor based hardware would wort well. The computations 
could be partitioned onto several processors in a Straightforward fashion that would 
not require excessive interproceesor communication- 

Ustng multiple processors is advantageous for several reasons, Most impor¬ 
tantly, additional computer power can he obtained incrementally by adding pro¬ 
cessors to the system. To -addition, the control program structure Is simplified by 
partitioning separate operations onto their own processor, A uniprocessor would 
require B. more complex scheduler, since many time critical events would need to 
be serviced in a complex fashion. Using multiprocessors alleviates this need. 

Since this system is used primarily as a research tool, it is important for the 
software development environment to be reasonably flexible, yet at the same time 
programs must ruu efficiently. These two goals are often con flitting, and a com pro¬ 
mise between them must be made,. Ail examination of two extremes in development 
approaches Illustrates this point. The Lisp Machine provides an elegant and pow^ 
■erful programming environment. However its flexibility makes it unsuitable for 
real time performance; a program, is so far removed from the machine's underlying 
hardware that efficiency is hard to achieve. Dedicated low performance microcom¬ 
puters, such as those used in the Unimation Puma controller, are at the other end 
of the computational spectrum. While they are suitable for handling real time 
events, they must be painfully programmed in assembly language, and lack the 
capabilities to support any hind of reasonable development environment. 

Another important question concerns the appropriateness of a computational 
hierarchy. In some robotics controllers, such as the MIT Puma system, only the 
lowest level control functions are relegated to the microprocessor front end. For 
many control tasks this necessitates relatively high bandwidth and low latency 
communications between the high level computer and the controller microproces¬ 
sors. The necessary rates are often hard to achieve using conventional hardware, 
such as an Ethernet connection. To avoid tliis problem altogether, our system de¬ 
sign assumes that almost all time- critical processing, including high level functions, 
should be handled on the microprocessor controllers, 
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Table i.i: Computational Components of the Hand Controller 


P roe essor Ly pit:: 

Clock rate: 

Instruction rate: 

Processor on board memory: 
Total processors: 

Total memory: 

Pus Architecture: 

Analog to digital converters: 
Digital to analog converters: 
Host computer 


Motorola fhSCHlX) 

12 megahertz 
s 1 MIP 

5 1 2 kilobytes 

4 megabytes 
Intel Multibus 
320 
40 

Vox via DMA Link 


Finally, a key consideration iu the design process was to ensure an easy path 
to future hardware and software Upgrades, This requires all software to have a 
device independent. Structure, In fact, we are already in the process of our first 
system upgrade; the current Motorola bftOOO processors are being converted to 
higher performance Motorola 6d02Q : s, So far the system port has gone smoothly, 
indicating that this requirement has been met. 


4.2 Con (roller Architecture 


Since almost all computer software and hardware projects seem to he given a name 
these days, we were forced to do so ourselves, The acronym decided upon was 
“MUSE 11 , It stands for various tilings, as do all computer science acronyms, in- 
eluding Lhc “MlT-Utah Servo loop Executor”- This section describes the hardware 
components that the MUSE is based upon. 

The processing engines used arc based on a 12 megahertz Motorola 6SQ0Q single 
board computer. They each are equipped with 512 kilobytes of storage, a prioritize 
interrupt controller, three event, timers, and two aerial ports. These features prove 
useful in various software components of the controller system- For comparison 
purposes, they perform integer arithmetic at approximately the rate of Digital. 
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1'i-gUFe 4,1; Microprocessor controller block dia jriu/i.. A Mvllibw? inteTeorintcts 8 6B000 
based single computers and warns reus dain acquisition devices. A pair of DMA con* 

trollies link a VAX host computer to the system. 

Equipment*® VAX 11/750, Table 4,1 Lists the system's component®, 

The eight processors and the peripheral equipment, are interconnected with an 
Intel Multibus. Each processor can become ft bus mftsJer, allowing it to take control 
of the bus anti access the shared peripherals. A parallel oriented priority resolu¬ 
tion controller arbitrates the processor bus requests, and grants bus control to one 
processor at a time in a fair fashion. In addition, each processor’s memory is duat 
ported; it can he accessed locally by the processor itself, or It can be accessed glob¬ 
ally by any other bus master. The hardware utilized provides maximum flexibility 
for system, reconfiguration since all processors can freely access all resources on the 
bus. A block diagram of the system is shown in Figure 4.1. 

To facilitate interprocessor communication, some additional hardware support 
is helpful. Since each processor's memory is dual ported Communication utilizes 
shared memory exchanges. To insure Orderly access ta common state information, 
a test, and set Instruction allows semaphores to be gracefully implemented. This 
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instruction sets an internal processor flag and sets a bit in a specified memory 
location,, only if the location was initially clear. The key point here is that the 
“testing* and “setting 1 " occur in Lhc same memory cycle. Without this hardware 
feature two processors could set a global flag at the same time* giving both of them 
access to the common information. The first processor could test the flag, and find 
it free. Tlte other processor could obtain use of the bus on the next cycle, and also 
find the flag clear. The first processor would then gain control of the bus, and set 
the flag. The second processor would then do the same, setting the flag for she 
second time, Both processors would think they were the only processor with access 
to the shared resources. 

Another feature used for interprocessor communication Is a mailbox interrupt. 
This allows a processor to generate an interrupt on another processor by writing 
to a particular location in that processor's memory. The interrupted processor can 
then use the contents of that memory location as a flag Indicating an action to Lake 
in response to the signal. 


The microprocessors are connected to a VAX 11/750 host computer with a high 
spend direct memory access (DMA) link. This connection allows the. VAX to write 
data directly into the contents of a microprocessors memory. During a transfer Lhu 
DMA controller on Lbe Multibus becomes a master and wriLes directly to a micro¬ 
processor's memory through its dual port, DMA transfers from a microprocessor 
to t-iie VAX are also possible. However., limitations in the structure of Multibus 
global interrupts make it convenient for only one microprocessor, hence referred to 
as the rrwwfer., to initiate transfers in this direction. 

The DMA connection between the microprocessors and the VAX allow data 
to be exchanged at a peak rate in excess of 200 kilobytes per second. The actual 
transfer rate obtained in moat Situations is lower and depends on such factors as the 
transfer size and the load on the VAX. However the bandwidth is higher than what, 
could bo achieved with either serial ports, parallel ports, or Ethernet connections, 
since once the data Lransfcr is initiated no processor intervention is necessary. 




§4 -S Safi urn rc Ca mpane nf.fi 


0& 


4.3 Software CcimpanentB 

Software is developed, on a VAX computer running Berkeley UX1X. Code is pri¬ 
marily written in C, with only a few of the lowest level routines coded in assembler 
language. 13 y utilizing a high level language, both the opera Liu r; system primi- 
lives and the conLrol code itself maintain a high level of hardware independence- 
■Since the system is intended to be continuously upgraded with more advanced and 
powerful microprocessing hardwares, software device independence is extremely im¬ 
portant. 

Tn a typical development scenario, programs are written on the VAX host in C, 
cross-compiled for the microprocessors,, downloaded using the DMA link, and then 
executed. The compile and download cycle is rather fast due to the DMA link’s 
speed: a download takes approximately one second. A primitive debugger that 
call be loaded with a program permits setting breakpoints and examining memory 
locations. At times the more capable debugging tools available, on the VAX can 
also be used. Since the VAX and microprocessor have compatible C compilers, 
routines will often run on both systems with Utile modification, 

A software Library of useful primitive procedures allow convenient use of the 
hardware„ and forma a key component of this system. Functions to handle inter¬ 
task communication, servo loop execution scheduling, file serving, and terminal 
interaction are included. 

The message passing based interprocessor communication system allows the 
microprocessors and the host computer to exchange information- This communi¬ 
cation scheme is device independent in the sense that the processors sending and 
receiving a message need not know how the information exchange actually takes 
place. This system is critical for building device independent application software. 

The servo loop execution system provides a primitive operating system sched¬ 
uler, Using the servo Loop scheduler, «, number of different speed servo loops can 
be executed on a processor at the same time. When all the servo Loops are idle a 
background task is activated. Since servo loops are run at extremely high rates, the 
scheduler 1 ? efficiency is of prime concern. This component illustrates the tradeoff 
between efficiency and flexibility quite well. A general purpose operating system 
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permits maximum scheduling Hocibility, at the expense of efficiency, Simple timer 
driven, interrupt loops require little execution overhead, but they are Inflexible. The 
servo loop scheduler is a compromise between these two conflicting requirements. 

The file server allows the microprocessors to access files on the host computer. 
Standard Unix-Like system calls are used. The file serving operations use the DMA 
link for high performance transfers. A process on the VAX receives file requests 
from the microprocessors and generates the Unix system calls to handle them. 
Terminal interaction among the microprocessors and the host computer utilize 
lower level file server capabilities. Microprocessor input and output occur over 
streams that are mapped to terminal input and ouLput queues on the host. 

The servo loop scheduler and the message passing system provide the basis for 
most of the functionality in the computational architecture support library. To¬ 
gether these subsystems provide the minimal level of flexibility needed for a control 
programming environment* and provide the control software with the necessary ab¬ 
stractions for device Independence. The next sections discuss these systems in more 
detail. 


J,.SA SfiTt'O j[.OOp Scheduling 

The servo loop scheduling system (SL5) allows a processor to run various control 
loops at different rates in a highly efficient manner. Since a typical hand control 
program will have several servo loops running at rates in excess oF 500 hertz, it 
is important for each scheduler invocation to be. font. To achieve this, scheduling 
flexibility has been limited to minimize the execution over!Lead that it requires. 
In Fact, it is a gross overstatement to cuil this an Operating system. It LS, in fact* 
just an efficient utility for programming a system timer and for staging procedures 
based oil precomputed rate information. 

The program listed in Figure A.2 uses the SLR to schedule loops running at 
&00 hertz and 1000 hertz. The sls-schedule routine is called for each task; a 
symbolic name for the procedure,, the C procedure name itself, and its rate In 
hertz, are passed as arguments. The call returns a pointer to the servo loops 
scheduling parameters. The ala-start initiates execution of the loops. The code 
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raain{) 

{ 

int force,. position; 

/*= Initialize the system *f 

force = a Is-schedule ("force control loop". aervolO, 1000); 
position = s la-scheduled''poaition control loop*, servo2Q, &0O) ' 


/* start in position control siode */ 
sls-pause[force); 
sls-startC); 


/* the following, code 
els-pause[position); 
s la *■ re s ume (force) ; 

sls-pauseCfoyee) : 
sls-resuma(position); 


runs as the "background 11 job *7 
/* now switch to.,, 

. force control mode */ 

l* now switch to... */ 

h - . . position control mode 


sarvol0 
C 

f* code for ths force control loop 
farce.control^update(); 

> 


&ervo2() 

{ 


f* code for the position control loop */ 
position_control_update(); 


Figure 4.2; Sample tc#e of the server loop sckedulr.r. In this psst aple, e program schedules 
i-ufp servo loops. In ths background job code, fore r corzjnp/ and position control art selected 
using the si e- pa use and si a-resume tot/tr/tund* 
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following the s Ls-start command is referred to as the lack-ground job, and runs 
when the servo loops are idle- 

Two additional commands, a Is-pause ami a Is-resume, allow specified servo 
loops to be suspended and restarted. These commands can be used by a servo loop 
or the background job. As shown in the example* a system that has a position 
control mode and a forte control mode might schedule two loops; one for position 
control* and the other for force control. The els-pause command could be used 
to disable the posit ion control loop when l he system is running in force control 
mode. To switch to position control,, the force control loop would be paused, and 
the position control loop resumed. 

A benefit of the SLS is that it simplifies the structure of control programs; 
the details of the interrupt and timer hardware are not mixed in with the control 
program code, This increases the overall portability of the system. 

To minimize execution, overhead, the SLS IS table driven. An tohie is 

automatically generated by the system when the sis-start command is issued. 
This table lists the elapsed time between invocations of the scheduled servo loop*. 
For example, the event table for two servo loops, one running every ten seconds and 
t.he other running every five seconds has two entries. The first entry indicates that 
both loops are to start, and live seconds elapSt until the next event. The second 
entry indicates tliat the five second loop should start, and another five seconds are 
to elapse before the next event. After this, the cycle repeats, and the first entry of 
the event table is reused, 

With the system outlined so far, it is possible for more than one loop to be 
runnable at the same time. The system must, have an orderly method for .selecting 
the actual loop that will be run from the set of runnable loops. A process fofcie is 
maintained for this purpose. All the ta&ks in the system are arranged, in order of 
decreasing servo rate, in this table. When the event table Indicates a loop ts ready 
Lo run, it. is marked runnable in the process tabic. The system then searches down 
the process table, aruf starts the fastest rale Loop that is marked runnable. 

The Lime to the next event scored in the event table is loaded into a timer on 
the processor. When the time has elapsed, the running task is interrupted, and 
the scheduler is reinvoked. The next tasks in the event table that are scheduled to 
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start are marked runnable in tile process tablfi. If a loop with a speed slower than 
the interrupted loop is made runnable, the interrupted loop will be resumed. If a 
higher speed servo loop is made runnable the slower loop that was interrupted will 
be temporarily suspended* until higher spend loops that are runnable complete. 

An implication of assigning a priority to a process, based on its rate is that a 
loop can only be interrupted by a higher speed loop, and hence* no coprocessing 
can take place. This is not considered to he a problem. The rate specified for a 
servo loop is a request, that the loop be run that number of times a second. The 
exact time that a loop is invoked 5a not important* as long as it is rune within its 
specified time slice, In other words, a loop scheduled to run every second is only 
a guarantee that the loop will run sometime within a second. A finer precision in 
selecting the time at which a procedure will run is not needed within onr control 
programming, scenario. 

Coprocessing ts not supported in the SLS’s restricted scheduling environment. 
Eliminating coprocessing results in a convenient simplification to the system; only 
one stack need be maintained for all the servo processes running on a processor. 
Stack pointers are not changed when a new process ie invoked* or a suspended 
process is resumed. 

When a loop terminates, the scheduler is also invoked. The terminating Loop 
is marked idle in the process table, and a new loop is selected to run. If no servo 
loops in the process table are runnable, the background job is activatad- 

Td help clarify the above discussion, Ifigure 4.3. diagrams the relationship be¬ 
tween the different components of the SLS. In this example, two loops are scheduled. 
Loop one is Invoked three times a second, and loop two is invoked once a second- 
The first event table entry sets loops one and two to runnable in the process table, 
'fhe system then selects loop one to run* since it runs at a faster rate than loop two. 
Loop Lwo will not run until it is the fastest loop marked active in the process table. 
The next event occurs i/3 of a second later, when loop one is to- be reinvoked. We 
see that in the first time slice of the diagram, loop one is active* and the system 
stack frame hae the activation record for loop one on its top. When loop One ter¬ 
minates, the scheduler Starts the fas Lest, active loop in the process table, Ln tilts 
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Figure 4.5: Servo hop scheduler ttmi'ttj (fiagi-em. The relationship fiettueew rimrunj servo 
loops, elapsed time, the system stack, the prpc.cs-it table rtrtd the event Idi^e are diagrammed. 
Tina iacipy are scheduled, Due ruanitaj (fcree times a second aad the other man-tug ones, a 
second, 


case, Snap two. While loop two is running, the next event occurs; the reactivation 
of loop one, Since loop one is now Lhc Fastest loop marked active in th* process 
table, it will interrupt loop Lwo. This occurs in time slice three of the diagram, 
The slack frame now has the activation record For Loop one on top of the record 
for loop two. When loop one terminates, its record is popped ofF the stack, and 
Loop two is resumed. This occurs in time slice Four, In time slice five loop two 
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terminates, none of the servo loops are active, and the background job is resumed, 
Finally, the third event in the cycle occurs, arid loop one is reinvoked. After this. 
Lire process repeats with the first entry In the event table. 

It is easy to detect when a processor cannot maintain & given set of servo loop 
rates. If a clock tick occurs and a servo loop that. the event table Indicates Is 
ready lo run. is already marked runnable in the process tabic, the desired servo 
rate cannot be maintained. In some cases we allow servo loops to overrun a small 
percentage of the time. For example, an extraordinary event that may require 
extra processing in a particular invocation of a loop can cause an infrequent, but 
tolerable, overrun. 

In timing tests It was found that the raw overhead of invoking a procedure 
with the. servo loop scheduler is low, In an application with one servo Loop, 19 
microseconds wore required to invoke the scheduler, on the average, In a test with 
four loops being scheduled to run at the same rate, 24 microseconds were required 
to schedule each loop. In a case with eight loops being scheduled at the same 
rate, 17 microseconds Were needed, The decrease in average time spent within the 
scheduler is due to the low cost of restarting a queued process. When many loops 
are scheduled at the same rate, they all are readied on the same dock tick. When 
a loop finishes, the time required to start a readied, but suspended, loop is very 
low. Another way of looking at this is that, scheduling a set of processes at rates 
that minimize interrupt overhead Is most efficient. 


4-3.2 Intertask Communications 

In a typical control application there are a number of tasks being scheduled by the 
SLS thaL must communicate with one another. The tasks may be running on any 
of the micros or host computers. Without a transparent form of communication, 
each task would need the exact routing Information needed for communicating 
with another routine, forcing the programmer to wire the execution Structure of 
the overall system into the control programs themselves. To make matters worse, 
the task would need to use different methods of communication depending on 
the specific processor receiving the information, To overcome these difficulties, 
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Table 4.2i The Fields of a Message Buffer 


Field 

Explanation 

Gender 

Virtual processor ID that sent message. 

recipient 

Virtual processor ID to receive message. 

sender-vdd 

Virtual mailbox (hr a reply message. 

recipient-vdd 

Virtual mailbox to receive message. 

me a g age--id, 

One byte user assigned message type. 

message-free 

Flag indicating message buFFer is free. 

buffer-length 

Message buffer length. 

buffer 

Message buffer. 


a message passing communication system, is utilized, A uniform communication 
protocol sends data between tasks running on the same processor, and between 
tasks running on different microprocessors or a host computer. 

Tasks send and receive data through uniformly formatted messages. The Fields 
i:i a message buffer can be classified into two broad categories. The fixed format 
fields are required, and are used by the message passing system for specific purposes. 
The ftee format message buffer is optional, and is used to implement higher level 
protocols using tbe low level transport mechanism. 

Messages are allocated with the bnlloc routine and are deallocated using 
hfree. In general, the messages are not freed by the processor that allocated 
them, and hence bfree cannot actually release the Storage. Instead, bfree just 
sets a garbage collection hit in the message buffer. At a later time the sending 
processor that issued the bailee garbage collects the freed buffers. In the current 
implementation calls to bailee periodically invoke the garbage collector, although 
oLher schemes could be employed. 

A message contains information that allows the router t.o send it to a recipient 
process, and information that allows the recipient process to send back &. reply. 
To be more specific, a recipient has two parts.: the sender virtual processor, and 
a routine that runs oil that virtual processor. Most commonly, virtual proces- 









Software Components 


103 


Tabic 4.3: Routing table example. Tk t> hitj J uiriimJ pr aee&sati Hiitwiitj cm £ rcai 

procesaare. 


Processor Zero 

Processor 

Channel 

Address 

zero-a 

self 

jump-tables 

zero-b 

self 

jump-table-b 

one 

mbus 

one 

VAX 

DMA 



Processor One 

Processor 

Channel 

Address 

Zcro-a 

mbits? 

zero 

zero-b 

mints 

sero 

one 

self 

jump-tabic-a 

VAX 

tubus 

zero 


Processor VAX 

Processor 

Channel 

Address 

zero-a 

DMA 


zero-b 

DMA 


one 

DMA 


VAX 

self 

juirip-table-a 


eon; correspond t.o t.he real processors in the system, and the recipient is just the 
processor number and a routine on that processor to invoke. The message buffer 
fields sender and. recipient contain the virtual processor number of the sending; 
processor and recipient processor respectively {sec Table 4.2). 

The recipient routine that is invoked when a message arrives is. referred to as a 
EJiriuaf dctucfl driver (VDD), The message field recipient-vdd contains an offset 
in a table on the receiving processor that points to the address of the routine that, 
is invoked for that message. Reply messages that arc directed hack to the sender 
invoke the routine indicated by aend-er-vdd. 

The table associating VDD numbers to routine addresses Is refereed to as the 
jump table. Every virtual processor has its own jump table. The sender-vdd and 
rece ipt-vdd fields contain offsets into this table, and not actual routine addresses, 
to simplify building a message passing system that runs cm multiple processors. 
Since addresses are not assigned Lo a procedure unlit a program is linked, it Is 
easier to refer to the VDD symbolically. The additional overhead that this requires 
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Sender; 

0 
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Sender-VDD: 

1 

3 

Recipierit-VDD: 2 — 

Message-ID: 

0 

Message-Free: 

no 

Buffer-Length: 

0 

Buffer: 

none 




I**! <1 S, S,-«ki..l 


Figure 4,4: Mewmye phasing system components. The VDD fields point to an offset ■"» 
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is small, and considered acceptable. 

Figure A A diagrams the relationships among the di irerern t components of the 
message passing system. Here, the message buffer field sender-vdd contains an 
offset in the recipient processors jump table. The jump table contains the addresses 
of the routines that, correspond to the VDDs assigned to that processor. Notice that 
the sending processor has no information as to the address of the VDD routine, 
allowing dynamic modification of VDD handler assignments. The fiondar-vdd 
hold points to an offset in the sender's jump table. This VDD offset, is used by the 
recipient processor to reply to the message. 

The actual process of sending a message is controlled by one routing table 
OIL each physical processor. This table associates a. virtual processor name with a 
communication channel and an address on that channel. A communication channel 
corresponds to a routine that is invoked to send the message. The address field is 
passed as an argument to that routine. In general, each physical method of sending 
a message has one communication channel routine. For example, the Multibus 
channel sends messages between microprocessors connected over that bus. The 
DMA channel sends messages between the VAX host processor and microprocessor 
zero, A pseudo channel called “"Eclf 71 sends local messages, and in effect causes a 
hranch to the associated jump table Tor execution of the message handler. 

Table 4.3 shows the routing tables for a message passing system “wiLh Tour virtual 
processors (zero-a, zero-b, one, and VAX) that run on three real processors (zero, 
one, and VAX), In this system, only real processor jero can communicate with 
the VAX using the DMA channel. Message forwarding must be used for processor 
one and processor VAX to communicate. In the rouLing table for processor one, 
messages destined to the VAX are sent to processor aero. When processor zero 
receives this message, the router noLlccs it is intended for processor VAX. and 
uses the DMA channel to complete the transfer. An arbitrary number of message 
forwarding hops can be handled by this scheme. 

A typical message passing system is shown in Figure 4-5- Two VDDs and three 
processors hav-o been defined. The sarvoVDD mailbox runs on processors zero and 
one while the vaxdataYSD runs on processor VAX, The main routine, possibly 
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mainO 

< 

neasage = bailee Q: 

M*sege->bnffer = fore ^information; 

e endmessag b (servo VOU „ite s sage ,0) ; 

Bendiness age(servoVDD.message,1); 

> 

a er voVDP { jtes sage) 

{ 

/* process the message */ 

proc eas_servo _ d&t a(n* s sag&->buf f er ); 

/* send data to the VAX +/ 

Bnother_message = bailee O; 

ano the r_ne ssa ge ->buf f e r m rilidOffl_dat*; 

sendees sage (vaxxiataVDD . ano ther_nes sage „ V) ; 

/* free the buffers when done +/ 

bf re s £ me s sagft); bf rte (ano tber.. me s sage ) ; 

> 

vaxda t aVCD £ ne ssa ge) 

{ 

prat &s* _V* K_d a ta £ me a e age->buffer); 
bfreefressage); 

> 

/* system wide message passing specification file +/ 
■fVDbtservoVDE. 01) 

■S VDD£ vaxda taVDD, V) 

fiPRO CE3 SCR (PRD CO. 0 } 

SPRnCE£SDR(FRDCl.1) 

*P RQGESSOR(PR0C VA X.VAX) 


Figure 1 ; d.S: Typical menage passing system specification Tun? VDDs and (Arc? preset- 
$ats gave Ufi.rj defined. 
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a master control program, sends a message to the: servoVDE mailboxes on both 
processor r,ero and processor one. Each servoVDD receive* the message and then 
forwards some data to LEie vaxdat-aVDD that runs on the VAX. The message passing 
system specification file, shown at the bottom of the figure, is used by the system 
to bnild the routing and jump table structures used by this configuration. 

A major advantage of using virtual device drivers is the case in which they can 
be relocated. For example, a VDD to invert matrices might be located on the VAX, 
If it is later decided to use a microprocessor to handle the matrix inversions, we 
just update the SV'ED commands to indicate their new location and recompile the 
system. 

The cost of the flexibility provided, is minimal. All VDD routing Is fixed at 
corn pile time, and does not incur substantial runtime overhead- In fact, the entire 
system is table driven. When a message arrives, the message handler issues a jump 
to the proper VDD handler. No procedure call overhead is required Lo process the 
message. Messages exchanged between the VAX and the micros are also relatively 
fast, due to the speed of the DMA link. 

The speed of the message passing system is demonstrated by a set oF bench¬ 
mark tests performed. Sending a message from one microprocessor to another 
takes 20 microseconds. Sending a message and receiving a return reply takes 40 
microseconds. Tn comparison. Digitalis RSX operating system’s message passing is 
slower; 20 milliseconds are required to send a message, and fiO millisecaiidjs elapse 
when sending a menage and receiving a reply. The time so send a message from 
a microprocessor lo the VAX, in our system, is slower. It takes 1 millisecond Lo 
send to the hand processor. This still is faster than the typicaL time required Lo 
send an RSX message. It should be noted that the speed advantage our system has 
over RSX is gained by simplicity. We feet, however, that irt the domain of control 
programming no functionality lias been lost, 

4,4 Performance Evaluation 

The computational architectum described is now operational and is actively being 
used to control the Utah-MlT hand, initially 5 microprecess*)rs were use in the 
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system, One processor was dedicated to each finder, and the remaining one was 
the master coordinating inter-finger activities and communications with the VAX. 
However, Lhe computational power provided proved inadequate for some of the 
initial tasks we wanted to perform. Each G800Q provides approximately 1 MIPS 
performance. If each processor servos 4 joints at 50A hertz, approximately 500 
Integer Instructions per joint per servo update are available. The C code used 
rather quickly exceeded this instruction quota. 

The system was then updated to 8 68000 processors t increasing overall perfor¬ 
mance by 3 MIPS. The computations wore partitioned somewhat differently; one 
processor was assigned all data acquisition needs, 5 processors handled finger com¬ 
putations, and l processor handled inter-finger coordination. This leaves one spare 
computer for future expansion, This level of performance has been adequate for 
Lhe current tasks being performed; full digital positional control and force control 
have been obtained. Floating point operations are not used in the current con¬ 
trol software- Instead, integer arithmetic with appropriate sealing operations Is 
employed. 

The current computations being performed are far less complex than those 
planned for the near future. Grasping operations will require computing the equiv¬ 
alent of a grip j&cobian |Mason and Salisbury 19S5; ITnllerbach et al. 1986 , a 
relatively complex task. In addition, the current lack of hardware floating point 
support may prove to be a problem. These computations will probably require 
the use of floating point operations to avoid numerical instabilities. The current 
hardware cannot handle these needs. Their Lack of floating point support is partic- 
ularly troubling; performing a floaiing point operation in software can often take 
50 times longer than ii would take using specialized hardware. 

The issue of whether llonLing point support is really required for control com¬ 
putations is often debated. Using integer arithmetic with proper sealing can often 
substitute for a full floating point implementation. However, certain computations 
cannot always be scaled by a fixed amount, requiring more complex dynamic scal¬ 
ing procedures. In the end, since the effort required to isolate the proper scaling 
operations may be large, and since dynamic scaling becomes quite complex, having 
hardware floating point capabilities is probably warranted. 
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To meet these needs., the computational architecture 13 currently being up¬ 
graded to Motorola 68020 processors based on Lhe YME bus. The. 68020 itself 
gives a factor of 2.5 speed improvement over the 68000 In integer arithmetic. In 
addition, the processor supports the Motorola 68881 floating point, coprocessor. 
The upgraded system will employ 10 processors giving a total of 25 MTPS inte¬ 
ger performance, a significant increase over the 8 MIPS available on the current- 
system. Sun workstations, also based on Lire Motorola 68020 architecture, will be 
used for development-. Control programming will be simplified by using the same 
processor for both the microprocessors and the host computer. 

To port the system, only limited modification to a few parts o-f the software 
library are required. The device dependent portions of the code are limited to low 
level software such as interrupt handlers, and timer and serial port controllers. AIL 
higher Level control code is entirely device Independent and need just he recompiled. 
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The opening paragraphs, of this thesis reflected on the amaaing capabilities of our 
hands, No robots hare yet boar able to achieve their level of versatility In manipula¬ 
tory and exploratory motions, Our h&nda can successfully function in unstructured 
environments that foil even the most sophisticated manipulators built to (lal-u. The 
moat important shortcomings occur with their dexterity, sensing capabilities, com¬ 
putational power, and algorithmic support. 

This thesis has addressed current robots 1 deficiencies in sensors and compu¬ 
tational support The proceeding chapters discussed a tactile sensor* a thermal 
sensor,, and a computational architecture suitable for use with an advanced dex¬ 
terous robotic device. The tools needed for realising a robot suitable for use in an 
unstructured environment are now in place; the Utah-MIT hand provides a high 
iovci oF dexterity, the sensors provide environment feedback, and the computational 
architecture gives it the needed number crunching power. 

The next sections in this concluding chapter briefly summarize the work pre¬ 
served in this thesis, and then discuss future research directions to be pursued. 


Ill 
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S.L Where Have We Gone So Far? 


A tactile sensor and a thermal sensor have been design and tested. The technologies 
employed permit fabrication or highly durable devices that can be mounted on 
curved surfaces like the fingers of the Utah-MIT hand. Their performance was 
found to be adequate for some of the sensor driven control tasks that are planned 
to be implemented on the Utah-MIT hand. 

The tactile array provides I x B forces sensors with 1.9 mm center-to-center 
spacing. Each cell provides 8 bits of force data over a 0 to 200 gram per square 
mm range. Its actual sensitivity can be controlled by varying the properties of 
Lis elastic-dielectric Layer, The device^ overall performance is influenced by Site 
size of the rubber tabs, the thickness of the covering sheet, and the actual silicone 
rubber used. AlLhough Lhc capacitance being detected l-i small,, proper electrical 
shielding minimkes the noise created by parasitic afreets. Hysteresis was found to 
be Eow, though a discussion questioned the importance of achieving low hysteresis; 
since the fingers need soft coverings, it is unlikely that hysteresis can altogether be 
eliminated. Important I y\ human touch sensing bas a high level of hysteresis yet. it 
maintains excellent performance. 

Tbe thermal device has a matrix of i X d cells with 2.5 mm center-loccntef 
spacing. By heating an object and measuring the resulting temperature change at 
the sensor’s surface, a material 1 !? type can be determined. Since the sensor has an 
array of thermal ceils, it can also detect the contact outline of an object. Several 
different, materials were classified using their characteristic thermal profile. 

The feasibility of combining the tactile and thermal sensor into one package was 
covered. Since the thermal sensor is passive, and docs not require direct mechanical 
contact with the external object being sensed* a layered device can b« constructed 
with tbe thermal sensor placed below the tactile sensor, The choice of materials is 
crucial for the performance of this dual modality device; the tact-iSo sensor musL be 
made of thermally conductive materials to allow heat to be exchanged freely with 
the thermal sen Ed r. 

Since a sensor equipped dexterous robot will require a high degree of Intelli¬ 
gence, and since the computational tasks that must, be performed are likely to be 
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compkjq a computational architecture with suitable performance was developed 
that meet these needs. The system described is actively being used to control! the 
Utah-MTT hand, It performs low level position and Force control servos at rates 
high enough for adequate performance [irollerbach and Narasimhan 1'966.. The 
hand control strategics being used have ample parallelism to be partitioned onto 
a set of & processors. The architecture is general purpose enough to permit use 
With Other robotics control projects. Currently, the MIT direct drive arm utilizes 
a system based on the components of this computational architecture. 

E>.£ What Comas IN’nxt.? 

This section explores gome future areas of research in sensing and computational 
support that will be required to fully realize a dexterous hand that can operate 
in unstructured environments. The discussion is divided into two sections. The 
hist -covers the remain in g work on the tactile and thermal sensors necessary for 
operating them with the Utah-MIT hand. The second discusses some higher level 
issues involved with achieving sensor based control. 

5,3,1 Improving the Tactile and Thermal Sensors 

Some work remains to be done before a fully operational sensor equipped dexterous 
hand can be realized. The Final details of the tactile sensor’s Fabrication process 
must- be worked out to insure long term reliability, A reduction in the size of a 
tactile cell la l .2 mm is under strong consideration. The current l ,9 mm center-to- 
center spacing is somewhat Largs for some planned tasks. Fortunately, the junction 
capacitance available for the smaller sized celts will still be large -enough to permit 
detection with adequate force resolutlon. 

Bonding wires to the flexible pad is anoLher important consideration, lip t.r> 
now the sensor has been mounted on a rigid printed circuit board. In the near 
future, fully flexible versions will he made that permit. mounting on the curved 
surfaces of the fingers, Small: wires must come out from the pad and be attached 
to the detection and scanning electronics. It is Important for these connections 
to be extremely reliable. An alternative design that uses a flexible printed circuit. 
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board that ira.ii be wrapped around the hand 'a lingers is also under development. 
This approach might lead Lo more reliable attachments. 

Since current plans call Tor maun tins -3 tactile arrays on each, of the hand : s A 
fingers, some work muRt. be done to further JTiinlat urine the scanning and detection 
electronics. Currently the only electronic? mounted near the sensor array arc the 
primary row amplifiers, They must be placed near the pad to reduce stray capac¬ 
itance effects. To minimize the wiling nightmare that the 12 sensor pads would 
create, multiplexing must be done oil the lingers themselves. Since the space avail¬ 
able is so small, hybrid circuit fabrication LS being considered. This will also permit 
further signal amplification Lo lie done close to the sensors, possibly Increasing their 
overall performance. 

More attention mild given to modeling the tactile sensor’s performance. A 
detailed mechanical model would give a better understanding of many of the design 
decisions that were made. Tor example, the elastic-dielectric material lias many 
design parameters that can be varied. The actual mechanical properties of the 
silicone rubber, the size and height of the rubber tabs, and the thickness of the 
surface covering can all be varied. A detailed analysis of how these factors affect 
overall sensor performance is certainly warranted. Alternatives to the rubber tabs 
could be considered. A continuous silicone rubber material with embedded air 
pockets, like a gponge, is also a possibility, 1 

A sensor’s reliability is of the utmost importance. Unfortunately, putting a 
sensor in a durable package often reduces it sensitivity. The sensors discussed in 
this thesis am fairly reliable, though much more LcsLing is needed to ascertain their 
long term performance. Perhaps it would be best to form the sensor with an easily 
replaceable covering. Provision? must be made, however, to allow the covering lo 
bond firmly to Lhc sensor’s surface, or had mechanical interactions between them 
might result. 

Some work remains to be done before the eombmal ion tactile and thermal sensor 
can be realised. Since the thermal sensor Is to be placed behind the tactile sensor, 

L A il advLLtJtig.i: of LIlu labs is that L-tiey cciiccnlrdli: I In: rubber nb the l apneilnr’j; junction and 
UiCK&ae its dielectric 6£> Beta lit. A sponge tike null is: Jill *v<ruLet Il:lve some air porltitks At junction 
situs, reducing the dielectric effect. 
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the heat capacity and heat conductivity of the elastic-dielectric material must be 
suitably high. Tf the tactile sensor formed a thermal barrier, the performance of 
the thermal sensor would be seriously degraded. Materials suitable for this purpose 
must, he isolated. 


S.&.2 Se.nsor £oietll Hand Motions 

The broader issuer of how to integrate contact sensor data into hand control strate¬ 
gies needs further investigation.. To date, few successful system that actively uLilisie 
contact sensor data have been developed. With robots like the Utah-MIT hand 
and sensors like the ones described in this thesis, advances, in this field should now 
be possible, 

A fundamental analysis of tactile sensor based operations must be performcd. 
Tuke the Lask of programming the hand to grip objects and to automatically com¬ 
pensate for potential slippage, Firstly, the phenomena of slippage must be thor¬ 
oughly investigated. The exact mechanical interaction'? between the hand and the 
object, as seen by the fingertip contact sensors, must be quantified. Then the grasp 
planner must be designed to utilise not only' the geometrical model of the object 
and the Hand, but the sensing data being acquired in real time. In essence, the 
Constraints provided by sensory data must be considered with the same importance 
as those provided by the static world model. 

Much information can be gained by investigating how the- human hand uses 
sensory information. Ludeirman and Klatzky\s [19fts| pioneering work in the area 
of haptic perception and recognition of common objects 5s a useful starL. They 
define a set of ^knowledge directed procedures 1 ’ that the haptic system might use 
to obtain information about a material f s intrinsic properties. For example, to 
obtain an object’s weight, an unsupported holding strategy ig used. Shape and else 
can be found by enclosure or dynamic contour exploration. Textural information 
is obtained by relative motions between the hand and the object,. 

The Ledcrman and Klatsky work emphasises the importance of the hand as 
a sensory organ. A robotic hand can be made to perform some of these same 
haptic functions. The sensory data it obtains can supplement other sources of 
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Information, primarily vision. The whole area of haptics and fusion of multiple 
sensory sources requires much additional research. Ultimately, a robust rohotica 
system that can handle large amounts of modeling uncertainty will be possible, In 
facts such a robotics device will actually be able to explore its own environment, 
■obtaining the information that it needs to accomplish particular operations. 

Are there tasks that a band with touch sensors can perform that a hand without 
sensors is incapable of achieving? This question is asked by many, though no formal 
answer has yet been given, Most researchers In the field believe that, contact sensory 
information plays a crucial roEe in the human hand's operations, and conclude that 
the same holds for robot hands. The robotic sensor field would be given a big 
boost by a demonstration that this assumption is really correct. Perhaps the most 
convincing argument would be a demonstration of a sensor equipped robotic hand 
performing a complex operation that to date has only hee-n done by humans. 

Though much work remains, this thesis has shown that an artificial hand with 
advanced sensory capabilities is now well within our reach. The sensor equipped 
Utah-MIT hand lias the potential to provide advances in automation and prosthetic 
devices, and to give US a better understanding of motor control.. Devices like this 
will allow robots to emerge from the structured world that they are confined to 
today. 
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